WO2019019232A1 - 基于vr头戴设备播放视频的方法及vr头戴设备 - Google Patents

基于vr头戴设备播放视频的方法及vr头戴设备 Download PDF

Info

Publication number
WO2019019232A1
WO2019019232A1 PCT/CN2017/098115 CN2017098115W WO2019019232A1 WO 2019019232 A1 WO2019019232 A1 WO 2019019232A1 CN 2017098115 W CN2017098115 W CN 2017098115W WO 2019019232 A1 WO2019019232 A1 WO 2019019232A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
user
scene
area
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/098115
Other languages
English (en)
French (fr)
Inventor
李铁成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Publication of WO2019019232A1 publication Critical patent/WO2019019232A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video

Definitions

  • the present application relates to the field of three-dimensional display technologies, and in particular, to a method for playing video based on a virtual reality (VR) headset and a VR headset.
  • VR virtual reality
  • Unity3D is a game engine that can create 3D video games, real-time 3D animations, etc. Because of its powerful functions, VR technicians are increasingly inclined to use Unity3D technology to create 3D virtual scenes. In many VR headsets, such as Helmet Mounted Display (HMD) devices, 3D virtual scenes are created using Unity3D technology.
  • HMD Helmet Mounted Display
  • Some embodiments of the present application provide a method for playing a video based on a VR headset, including:
  • the method further includes:
  • At least one VR functional area is displayed, and at least one of the VR functional areas includes a video playing area;
  • the determining, according to the point of interest of the user in the VR scenario, whether the user selects the video play area includes:
  • the VR scene further includes a selection interaction area associated with the video play area;
  • Determining, according to the point of interest of the user in the VR scenario, whether the user selects the video play area includes:
  • the determining, according to an operation of selecting a target video file from the plurality of video files, determining the target video file to be played includes:
  • the third time length is greater than the set third time length threshold, determining that the video file corresponding to the user's point of interest is the target video file.
  • the VR scene is a 360-degree panoramic view; displaying a video playing interface in the VR scene, including:
  • a screen is displayed on the curved area corresponding to the center of the user's perspective in the 360 degree panoramic view as the video playing interface.
  • the VR scenario further includes a control interaction area associated with the video play interface, where the control interaction area includes at least one type of play control control;
  • the method further includes:
  • the decoder is an XBMC decoder.
  • the decoder in the calling dynamic link library decodes the target video file into video data that is adapted to the VR scenario, including:
  • the decoder is called to decode the target video file frame by frame and output the decoded video data of each frame to the frame buffer object; wherein the video data of each frame is automatically outputted to the texture object.
  • the rendering the video data into the video playing interface to obtain a video image includes:
  • the texture object in the rectangular window is rendered in the VR scene by calling OpenGL to output the video screen in the video playback interface.
  • Some embodiments of the present application further provide an apparatus for playing video based on a VR headset, including:
  • a display module configured to display a video information interface in a VR scenario according to a request message for viewing a video requested by a user, where the video information interface includes a plurality of video files;
  • a determining module configured to determine the target video file to be played in response to an operation of selecting a target video file from the plurality of video files
  • Calling a module configured to call a decoder in the dynamic link library to decode the target video file into video data adapted to the VR scene;
  • an output module configured to display a video playing interface in the VR scene, and render the video data into the video playing interface to obtain a video image.
  • the device further includes: a determining module
  • the display module is further configured to display at least one VR functional area in the VR scenario, and at least one of the VR functional areas includes a video play area;
  • the determining module is configured to determine, according to the point of interest of the user in the VR scenario, whether the user selects the video play area;
  • the determining module is further configured to: when the user selects the video playing area, determine that the user requests to watch a video.
  • the determining module is specifically configured to: track the user's point of interest based on the eyeball tracking technology; and record the user's point of interest when the user's point of interest is located in the video playing area The first time length of the video play area; when the first time length is greater than the set first time length threshold, determining that the user selects the video play area.
  • the VR scene further includes a selection interaction area associated with the video play area; and the determining module is specifically configured to: track the user's attention point based on the eyeball tracking technology; Recording, when the tracking point of the user is located in the selection interaction area, recording a second time length of the user's attention point in the selection interaction area; when the second time length is greater than the set second time length At the threshold, it is determined that the user selects the video play area.
  • the determining module is specifically configured to: track, according to an eyeball tracking technology, a point of interest of the user on the video information interface; and when the tracking of the user's point of interest corresponds to a video file, record the The user's point of interest corresponds to the third time length of the video file; when the third time length is greater than the set third time length threshold, the video file corresponding to the user's point of interest is determined to be the target video file.
  • Some embodiments of the present application further provide a VR headset device, including: a memory and a processor; the memory, configured to store a program, the processor, configured to execute the program in the memory, for:
  • the processor is further configured to:
  • At least one VR functional area is displayed, and at least one of the VR functional areas includes a video playing area;
  • the processor when determining, by the processor, whether the user selects the video play area, is specifically configured to:
  • the decoder is an XBMC decoder.
  • the processor when the processor invokes the decoder, the processor is specifically configured to:
  • the decoder is called to decode the target video file frame by frame and output the decoded video data of each frame to the frame buffer object; wherein the video data of each frame is automatically outputted to the texture object.
  • a communication bridge between the VR scene and the decoder is established through the dynamic link library, and the video file is decoded into a video data adapted to the VR scene by using a decoder, and then the video can be adapted according to the VR scene.
  • the data is rendered in the VR scene, so that the video can be played in the VR scene to meet the user's need to watch the video in the VR scene.
  • FIG. 1a is a flowchart of a method for playing video based on a VR headset device according to some embodiments of the present disclosure
  • FIG. 1b is a flowchart of a method for playing video based on a VR headset device according to another embodiment of the present disclosure
  • FIG. 2a is a flowchart of a method for playing video based on a VR headset device according to some embodiments of the present disclosure
  • FIG. 2b is a layout diagram of at least one VR functional area provided by some embodiments of the present application.
  • FIG. 2c is another layout diagram of at least one VR functional area provided by some embodiments of the present application.
  • FIG. 3 is a schematic structural diagram of an apparatus for playing video based on a VR headset device according to some embodiments of the present disclosure
  • FIG. 4 is a schematic structural diagram of an apparatus for playing video based on a VR headset device according to some embodiments of the present disclosure
  • FIG. 5 is a schematic structural diagram of a VR headset device according to some embodiments of the present disclosure.
  • FIG. 6 is a schematic diagram of an internal configuration structure of a VR headset display device according to some embodiments of the present disclosure.
  • Some embodiments of the present application provide a solution for playing video in a VR scenario, and the main principles are as follows:
  • the dynamic link library (DLL) is used to establish the communication bridge between the VR scene and the decoder developed by Unity3D.
  • the dynamic link library can be called, and the video file can be decoded into a VR scene by using the decoder.
  • the adapted video data can further render the video picture in the VR scene according to the video data adapted to the VR scene, so that the video can be The video is played in the scene to meet the needs of the user to watch the video in the VR scene.
  • the VR scene may be developed prior to playing the video in the VR scene.
  • Unity3D can be used to develop VR scenarios.
  • a dynamic link library is created, a decoder is implemented in the dynamic link library, and a method for calling the decoder is implemented, so that the decoder can be accessed through the dynamic link library in the VR scene.
  • the dynamic link library becomes a communication bridge between the VR scene and the decoder.
  • the dynamic link library can be used to call the decoder to decode the video file into video data adapted to the VR scene, thereby playing the video in the VR scene.
  • the method for calling the decoder implemented in the dynamic link library can have various implementations, and any implementation method that can be used by the external application to call the decoder can be applied to some embodiments of the present application.
  • a method logic for invoking a decoder implemented in a dynamic link library will be described in some subsequent embodiments, and will not be described herein.
  • FIG. 1a is a flowchart of a method for playing video based on a VR headset device according to some embodiments of the present disclosure. As shown in Figure 1a, the method includes:
  • step 10a the user wears a VR headset, and the VR headset can present the VR scene to the user.
  • the VR headset device displays a video information interface to the user in the VR scenario according to the request message of the user requesting to view the video.
  • the video information interface includes a plurality of video files for the user to select the target video file to be viewed.
  • step 10b the user can select a target video file that he wants to view from a number of video files.
  • a VR headset it can be responsive to selecting a target video from a number of video files The operation of the piece determines the target video file to be played.
  • step 10c after determining the target video file, the VR headset can invoke a decoder in the dynamic link library, and the decoder decodes the target video file into video data that is adapted to the VR scene.
  • the VR headset displays a video playing interface in the VR scene, and renders the video data decoded by the decoder into a video playing interface to obtain a video image.
  • the video picture being played by the video playing interface in the VR scene can be viewed, and the purpose of watching the video in the VR scene is realized.
  • the type of the decoder is not limited, and any decoder may be employed.
  • a MediaPlayer decoder a storm video decoder, or an XBMC decoder may be used.
  • the video formats supported by different decoders are different, and the decoder can be selected according to the video format that the VR scene needs to support.
  • XBMC is a free and open source (GPL) media center software that not only plays almost all popular audio formats and audio and video formats, but also plays network media, supports various network media protocols, supports hardware decoding, and supports multiple platforms.
  • GPL free and open source
  • some embodiments of the present application adopt an XBMC decoder, thereby utilizing the advantages of XBMC to support multiple audio and video formats, so that video files of multiple formats can be played in the VR scene developed by Unity3D.
  • an XBMC decoder is employed.
  • FIG. 1b is a flowchart of a method for playing video based on a VR headset device according to another embodiment of the present disclosure. As shown in FIG. 1b, the method includes:
  • the user wears a VR headset, and the VR headset can present the VR scene to the user.
  • the VR scenario in some embodiments of the present application mainly refers to a VR scenario implemented by using Unity3D.
  • the VR headset device displays a video information interface to the user in the VR scenario according to the request message of the user requesting to view the video.
  • the video information interface includes a plurality of video files for the user to select the target video file to be viewed.
  • the video file included on the video information interface may be a local video file, or may be based on a Server Message Block (SMB), Universal Plug and Play (UPnP), or a file.
  • Video files shared by network protocols such as File Transfer Protocol (FTP).
  • the video formats involved in the video files include video formats supported by the Android platform, such as mp4 and 3gp, and may also include video formats that are not supported by the Android platform, such as wov, rmvb, rm, tb, and the like.
  • XBMC technology is combined, so users can choose to play video files in various video formats.
  • the user can select a video file that is desired to be viewed from a plurality of video files of the video format.
  • the target video file to be played can be determined in response to an operation of selecting a video file from a plurality of video files of the video format.
  • the target video file here is the selected video file in the video files of multiple video formats.
  • the operation of selecting a video file from video files of a plurality of video formats is not limited, and any operation mode that can be recognized by the VR headset is applicable to the present application.
  • the VR headset can invoke the XBMC decoder in the dynamic link library, and the XBMC decoder decodes the target video file into video data that is adapted to the VR scene.
  • the VR headset displays a video playing interface in the VR scene, and renders the video data decoded by the XBMC decoder into a video playing interface to obtain a video image.
  • the video picture that is being played by the video playing interface in the VR scene can be viewed. The purpose of watching video in a VR scene.
  • the communication bridge between the VR scene developed by Unity3D and the XBMC decoder is established through the dynamic link library, and the video file is decoded into the video data adapted to the VR scene by using the XBMC decoder, and then The video picture is rendered in the VR scene according to the video data adapted to the VR scene, so that the video can be played in the VR scene developed by Unity3D, and the user needs to watch the video in the VR scene.
  • the VR headset device when the user requests to view the video in the VR scene, the VR headset device presents the video information interface to the user in the VR scene. Prior to this, it can be determined first whether the user requests to watch the video in the VR scene. Based on this, the flow of the method for playing video based on the VR headset device provided by other embodiments of the present application, as shown in FIG. 2a, includes the following steps:
  • At least one VR functional area is displayed, and at least one of the VR functional areas includes a video playing area.
  • the user wears a VR headset, and the VR headset can present the VR scene to the user.
  • the VR scene includes at least one VR functional area.
  • the VR function area refers to the VR function that the VR headset can provide to the user.
  • the video play area in at least one of the VR functional areas indicates that the VR headset can provide video playback functionality to the user.
  • the VR gaming area in at least one of the VR functional areas indicates that the VR headset can provide gaming functionality to the user.
  • at least one VR functional area may also include a functional area for urban planning, a functional area for interior design, a functional area for industrial simulation, a functional area for educational training, and the like.
  • At least one VR functional area may be arranged from left to right within a user's viewing angle range, as shown in Figure 2b.
  • at least one VR functional area may also be arranged in a list style within the user's perspective, as shown in Figure 2c.
  • the arrangement of at least one VR functional area is not limited to that shown in FIG. 2b and FIG. 2c.
  • the style of the VR scene shown in FIGS. 2b and 2c is only an example, and is not limited thereto.
  • VR function processing flows refer to the processing flow of other VR functions
  • other VR functions refer to VR functions corresponding to other VR functional areas outside the video playing area.
  • the user can select their desired VR function from at least one of the VR functional areas by turning the head and/or eyes.
  • the eyes can be focused to the VR function area corresponding to the VR function, and the focus point of the user's eyes in the VR scene, that is, the focus point.
  • the eyeball tracking technology can be used to track the user's attention in the VR scene.
  • the eyeball tracking technology can extract eye features according to changes in the characteristics of the eyeball and the periphery of the eyeball, changes in the iris angle, or actively projecting infrared rays to the iris, and then determine the focus of the user in the VR scene according to the eye features and the VR scene.
  • the implementation process of step 201 includes: tracking the user's point of interest based on the eyeball tracking technology; and recording the user's point of interest in the first time of the video playing area when the user's point of interest is located in the video playing area Length; then determining whether the first time length is greater than the set first time length threshold; if the first time length is greater than the first time length threshold, determining that the user selects the video play area.
  • the user can give an instruction to select a video play area to the VR headset by watching the video play area for a certain period of time; the VR headset can determine that the user selects the video play area according to the user's behavior.
  • the VR scene in addition to including at least one VR functional area, includes a selection interaction area that is in one-to-one correspondence with each VR functional area. For the user, a certain VR functional area can be selected through these selection interaction areas. For the video play area, the user can select the video play area through the selected interactive area associated with the video play area in the VR scene.
  • step 201 includes: tracking the user's point of interest based on the eyeball tracking technology; when the tracking of the user's point of interest is located in the selection interaction zone, recording the user's point of interest is located in the second time length of the selection interaction zone; Determining whether the second time length is greater than the set second time length threshold; if the second time length is greater than the second time length threshold, determining that the user selects the video play area.
  • step 203 Determine that the user requests to watch the video in the VR scenario, and proceeds to step 203.
  • the VR scene is a 360 degree panoramic view.
  • the video information interface can be displayed on the curved area corresponding to the center of the user's perspective in the 360 degree panoramic view. In this way, the user can see the video information interface without turning or turning the head greatly, so that the user can select the target video file in time and quickly, thereby improving the video playing efficiency.
  • the video information interface can include multiple regions.
  • a list area may be included for displaying the name of each video file.
  • a thumbnail area may be included for displaying thumbnails of respective video files.
  • a search area may be included for the user to search for a video file, and the search term supported by the search area may be information such as a video format, a type, a name, an actor name, a release time, and the like of the video file.
  • a screen may also be displayed on the curved area corresponding to the center of the user's perspective in the 360 degree panoramic view as a video playing interface. In this way, the user can see the video picture without turning or turning the head greatly, which is beneficial to improve the viewing experience of the user.
  • the target video file may be determined according to the user's point of interest.
  • the eyeball tracking technology can be used to track the user's attention point on the video information interface; when the tracking of the user's attention point corresponds to a video file, the third time length of the video file corresponding to the video file is recorded; When the third time length is greater than the set third time length threshold, it is determined that the video file corresponding to the user's attention point is the target video file.
  • the VR headset is equipped with a trackpad.
  • step 10b, step 102 or step 204 the user can select from each video file by turning the head and/or eyes. Look at the target video file and issue a command to confirm the selection via the touchpad.
  • the focus of the user on the video information interface can be tracked based on the eyeball tracking technology; when the tracking of the user's attention point corresponds to a video file, waiting for the confirmation sent by the user through the touchpad The instruction is selected; when the confirmation selection instruction is received, it is determined that the user selects the video file corresponding to the point of interest as the target video file.
  • the VR headset is equipped with a handle. Then, in step 10b, step 102 or step 204, the user can select the target video file that he wants to watch from each video file through the handle and issue an instruction to confirm the selection. For the VR headset, the operation of the handle can be detected, and the command issued by the handle can be recognized to determine the video file selected by the user as the target video file.
  • an implementation of step 10c, step 103, or step 205 is actually a method logic for invoking a decoder (eg, an XBMC decoder) implemented in a dynamic link library, including:
  • Texture objects are mainly used to store texture data required for each frame of video animation, such as pixel data including texture, texture size, texture parameters, and so on.
  • Dynamic Link Library is created during the development of VR scenarios based on Unity3D.
  • the frame buffer object allows the XBMC decoder to output the decoding result to the frame buffer object instead of outputting to the screen.
  • the frame buffer object may also output the decoding result of the XBMC decoder to the texture object, which provides a basis for rendering the video image in the VR scene.
  • each frame of video data mainly refers to texture data required for each frame of video animation, such as pixel data including texture, texture size, texture parameters and the like.
  • the decoder is implemented in a dynamic link library, and its entire life cycle (eg, initial, loop, end) can be It is easy to control the running rhythm of the decoder by monitoring in the dynamic link library.
  • the dynamic link library and decoder can be written in the C++ language, but is not limited thereto.
  • the texture object may be transferred to a rectangular window corresponding to the video playing interface; and the rectangular window is rendered in the VR scene by calling OpenGL.
  • the rectangular window is a representation of the video playing interface on the screen of the VR headset device, that is, a rectangular window is created on the screen of the VR headset device, and the video playing interface in the VR scene is obtained through rendering.
  • each frame of the video animation is decoded by the decoder onto the texture object, and the texture object is rendered frame by frame by calling OpenGL, so that the video picture can be seen in the VR scene. Achieve the effect of watching videos in a VR scene.
  • the VR scenario described above further includes a control interaction zone associated with the video playback interface.
  • the control interaction zone may be located in a certain area of the video playing interface, such as an upper left corner, an upper right corner, a lower left corner, or a lower right corner.
  • the control interaction area is located in an area other than the video play interface in the VR scene, such as a lower area, a left area, a right area, or an upper area of the video play interface.
  • the control interaction zone includes at least one type of play control controls. Through these playback control controls, the user can control the playback state of the video animation in the video playback interface.
  • at least one type of playback control control may include, but is not limited to, a fast forward control, a pause control, an end control, a volume adjustment control, a small window playback control, and the like.
  • the VR headset device can also track the attention point on the user according to the eyeball tracking technology, and determine the user from the at least one according to the focus point of the user in the VR scene.
  • the target play control control selected in the class play control control; and further controlling the play state of the video screen according to the control event associated with the target play control control.
  • the VR headset when the user selects the fast forward control, the VR headset can speed up the video playback interface. The speed of the video animation.
  • the VR headset when the user selects the pause control, the VR headset can pause playing the video animation in the video playback interface.
  • the VR headset when the user selects the volume adjustment control, the VR headset can increase or decrease the playback volume of the video animation in the video playback interface.
  • at least one type of play control control is provided by controlling the interaction area, so that the user can flexibly control the play status of the video picture according to his own viewing requirements, which is beneficial to improving the user experience.
  • FIG. 3 is a schematic structural diagram of an apparatus for playing video based on a VR headset device according to some embodiments of the present disclosure. As shown in FIG. 3, the apparatus includes: a display module 31, a determination module 32, a calling module 33, and an output module 34.
  • the display module 31 is configured to display a video information interface in the VR scenario according to the request message of the user requesting to watch the video, where the video information interface includes several video files.
  • the VR scenario may be a VR scenario developed using Unity3D technology.
  • the determining module 32 is configured to determine a target video file to be played in response to an operation of selecting a target video file from the plurality of video files.
  • the calling module 33 is configured to call a decoder in the dynamic link library to decode the target video file into video data adapted to the VR scene.
  • the output module 34 is configured to display a video playing interface in the VR scene, and render the video data into the video playing interface to obtain a video screen.
  • the apparatus further includes: a determining module 35.
  • the display module 31 is further configured to display at least one VR functional area in the VR scene before the video information interface is displayed in the VR scene, and at least one of the VR functional areas includes a video playing area.
  • the determining module 35 is configured to determine, according to the point of interest of the user in the VR scenario, whether the user selects the video playing area.
  • the determining module 32 is further configured to: when the determining module 35 determines that the user selects the video playing area, determine that the user requests to watch the video, and then trigger the display module 31 to display the video information interface in the VR scene.
  • the determining module 35 is specifically configured to: track the user's point of interest based on the eyeball tracking technology; and record the note when the user's point of interest is located in the video playing area The user's attention point is located in the first time length of the video playing area; when the first time length is greater than the set first time length threshold, it is determined that the user selects the video playing area.
  • the VR scene further includes a selection interaction area associated with the video play area.
  • the determining module 35 is specifically configured to: track the user's point of interest based on the eyeball tracking technology; and when the tracking of the user's point of interest is located in the selected interaction zone, record the user's point of interest at the Selecting a second time length of the interaction area; determining that the user selects the video play area when the second time length is greater than a set second time length threshold.
  • the determining module 32 determines, when determining the target video file to be played, in response to the operation of selecting the target video file from the plurality of video files, specifically: tracking the image based on the eyeball tracking technology a point of interest of the user on the video information interface; when the tracking of the user's point of interest corresponds to a video file, recording a third time length of the user's point of interest corresponding to the video file; When the length of time is greater than the set third duration threshold, the video file corresponding to the user's point of interest is determined to be the target video file.
  • the VR scene is a 360-degree panoramic view; when the output module 34 displays a video playing interface in the VR scene, specifically, the corresponding information is used in the 360-degree panoramic view.
  • a screen is displayed on the curved area of the center of the user's perspective as the video playing interface.
  • the decoder may be an XBMC decoder, but is not limited thereto.
  • the calling module 33 is specifically configured to: create an OpenGL texture object, and pass the texture object into the dynamic link library; create an OpenGL frame buffer object in the dynamic link library, And attaching the texture object to the frame buffer object; invoking the decoder to decode the target video file frame by frame and output the decoded each frame of video data to the frame buffer object; wherein Each frame of video data is automatically output to the texture object.
  • the output module 34 is specifically configured to: send the texture object to the video playing interface. In the rectangular window; rendering the texture object in the rectangular window in the VR scene by calling OpenGL to output the video screen in the video playing interface.
  • the VR scene further includes a control interaction area associated with the video play interface, where the control interaction area includes at least one type of play control control.
  • the output module 34 is further configured to: after rendering the video data into the video playing interface, to obtain a video image, determining, according to the user’s point of interest in the VR scenario, the user Determining a target play control control selected in at least one type of play control control; controlling a play status of the video picture according to a control event associated with the target play control control.
  • the device provided in this embodiment may be used to perform the method for performing video playback by the VR headset device provided by the foregoing embodiment.
  • the specific working principle is not described here. For details, refer to the description of the method embodiment.
  • the device for playing video based on the VR headset device in the embodiment provides a communication bridge between the VR scene and the decoder through the dynamic link library, and uses the decoder to decode the video file into video data adapted to the VR scene, and then The video picture is rendered in the VR scene according to the video data adapted to the VR scene, so that the video can be played in the VR scene to meet the user's demand for watching the video in the VR scene.
  • the VR headset can include a memory 51 and a processor 52.
  • the memory 51 is mainly used to store programs.
  • the memory 51 can also be configured to store other various data to support operations on the VR headset. Examples of other various data include program data, messages, pictures, and the like.
  • the memory 51 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • the processor 52 is configured to execute a program stored in the memory 51 for:
  • the processor 52 before the processor 52 displays the video information interface in the VR scenario, the processor 52 is further configured to:
  • At least one VR functional area is displayed, and at least one of the VR functional areas includes a video playing area;
  • the processor 52 when determining, by the user, whether the user selects the video play area according to the point of interest of the user in the VR scenario, is specifically configured to:
  • the VR scene further includes a selection interaction area associated with the video play area. Based on this, the processor 52 determines whether the user selects the video play area according to the point of interest of the user in the VR scenario, specifically for:
  • processor 52 is responsive to selecting from the plurality of video files The operation of the target video file, when determining the target video file to be played, specifically for:
  • the third time length is greater than the set third time length threshold, determining that the video file corresponding to the user's point of interest is the target video file.
  • the VR scene is a 360 degree panoramic view. Based on this, when the processor 52 displays the video playing interface in the VR scene, the processor 52 is specifically configured to display a screen on the curved area corresponding to the center of the user's perspective in the 360-degree panoramic view.
  • the video playback interface is specifically configured to display a screen on the curved area corresponding to the center of the user's perspective in the 360-degree panoramic view.
  • the VR scene further includes a control interaction area associated with the video play interface, where the control interaction area includes at least one type of play control control.
  • the processor 52 is further configured to: after obtaining the video picture, determine, according to the attention point of the user in the VR scene, the target play control control selected by the user from the at least one type of play control control And controlling a playing state of the video screen according to a control event associated with the target playback control control.
  • the decoder is an XBMC decoder, but is not limited thereto.
  • the processor 52 when the decoder 52 in the dynamic link library is called to decode the target video file into video data that is adapted to the VR scene, the processor 52 is specifically configured to:
  • the decoder is called to decode the target video file frame by frame and output the decoded video data of each frame to the frame buffer object; wherein the video data of each frame is automatically outputted to the texture object.
  • the processor 52 when the video data is rendered into the video playing interface to obtain a video picture, the processor 52 is specifically configured to:
  • the texture object in the rectangular window is rendered in the VR scene by calling OpenGL to output the video screen in the video playback interface.
  • the VR headset device may include a display screen 53, a binocular lens (Lens) 54, an inertial detection unit (IMU) 55, and a speaker 56 in addition to the memory 51 and the processor 52. And other components. Only some components of the VR headset are shown in FIG. 5, not all components. Those skilled in the art can understand that the VR headset may include other components in addition to the components shown in FIG. 5, and may of course not include. Some components shown in Figure 5.
  • the display screen 53 may employ an LED display screen, but is not limited thereto.
  • the IMU 55 may include a gyroscope, a magnetometer, an accelerometer, and the like.
  • the VR headset provided in this embodiment can play video in the VR scenario to meet the requirements of the user watching the video in the VR scenario.
  • the electronic device may be an external head mounted display device or an integrated head mounted display device, wherein the external head mounted display device needs to be used in conjunction with an external processing system (eg, a computer processing system).
  • an external processing system eg, a computer processing system
  • FIG. 6 shows a schematic diagram of the internal configuration of the head mounted display device 600 in some embodiments.
  • the display unit 601 may include a display panel disposed on a side surface of the head mounted display device 600 facing the user's face, and may be a one-piece panel or left and right panels corresponding to the left and right eyes of the user, respectively.
  • the display panel may be an electroluminescence (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a laser-scanned display in which the retina may be directly displayed or similar.
  • EL electroluminescence
  • the virtual image optical unit 602 photographs the image displayed by the display unit 601 in an enlarged manner, and allows the user to observe the displayed image in the enlarged virtual image.
  • the display image outputted to the display unit 601 it may be an image of a virtual scene supplied from a content reproduction device (a Blu-ray disc or a DVD player) or a streaming server, or an image of a real scene photographed using an external camera 610.
  • virtual image optical unit 602 can include a lens unit, such as a spherical lens, an aspheric lens, a Fresnel lens, and the like.
  • the input operation unit 603 includes at least one operation member for performing an input operation, for example, pressing A key, button, switch or other component having similar functions receives a user command through the operating component and outputs an instruction to the control unit 607.
  • the status information acquiring unit 604 is configured to acquire status information of the user wearing the head mounted display device 600.
  • the status information acquisition unit 604 may include various types of sensors for detecting status information by itself, and may acquire status information from an external device such as a smartphone, a wristwatch, and other multi-function terminals worn by the user through the communication unit 605.
  • the status information acquisition unit 604 can acquire location information and/or posture information of the user's head.
  • the status information acquisition unit 604 may include one or more of a gyro sensor, an acceleration sensor, a global positioning system (GPS) sensor, a geomagnetic sensor, a Doppler effect sensor, an infrared sensor, and a radio frequency field intensity sensor.
  • GPS global positioning system
  • the state information acquisition unit 604 acquires state information of the user wearing the head-mounted display device 600, for example, acquires, for example, an operation state of the user (whether the user wears the head-mounted display device 600), an action state of the user (such as standing, walking, running) And the state of movement such as the state of the hand or fingertip, the open or closed state of the eye, the direction of the line of sight, the size of the pupil, the mental state (whether the user is immersed in observing the displayed image, and the like), or even the physiological state.
  • an operation state of the user whether the user wears the head-mounted display device 600
  • an action state of the user such as standing, walking, running
  • the state of movement such as the state of the hand or fingertip, the open or closed state of the eye, the direction of the line of sight, the size of the pupil, the mental state (whether the user is immersed in observing the displayed image, and the like), or even the physiological state.
  • the communication unit 605 performs communication processing with the external device, modulation and demodulation processing, and encoding and decoding processing of the communication signal.
  • the control unit 607 can transmit transmission data from the communication unit 605 to an external device.
  • the communication method may be wired or wireless, such as mobile high-definition link (MHL) or universal serial bus (USB), high-definition multimedia interface (HDMI), wireless fidelity (Wi-Fi), Bluetooth communication, or low-power Bluetooth communication. And the mesh network of the IEEE802.11s standard.
  • communication unit 605 can be a cellular wireless transceiver that operates in accordance with Wideband Code Division Multiple Access (W-CDMA), Long Term Evolution (LTE), and the like.
  • W-CDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • the head mounted display device 600 can also include a storage unit, which is a mass storage device configured to have a solid state drive (SSD) or the like.
  • storage unit 606 can store applications or various types of data. For example, content viewed by a user using the head mounted display device 600 may be stored in the storage unit 606.
  • the head mounted display device 600 can also include a control unit, and the control unit 607 can include a computer processing unit (CPU) or other device having similar functionality.
  • the control unit 607 can be used to execute an application stored by the storage unit 606, or the control unit 607 can also be used to execute the circuits, functions, and operations disclosed in some embodiments of the present application.
  • the image processing unit 608 is for performing signal processing such as image quality correction related to the image signal output from the control unit 607, and converting its resolution into a resolution according to the screen of the display unit 601. Then, the display driving unit 609 sequentially selects each row of pixels of the display unit 601, and sequentially scans each row of pixels of the display unit 601 row by row, thereby providing a pixel signal based on the signal-processed image signal.
  • the head mounted display device 600 can also include an external camera.
  • the external camera 610 may be disposed on the front surface of the body of the head mounted display device 600, and the external camera 610 may be one or more.
  • the external camera 610 can acquire three-dimensional information and can also be used as a distance sensor. Additionally, a position sensitive detector (PSD) or other type of distance sensor that detects reflected signals from the object can be used with the external camera 610.
  • PSD position sensitive detector
  • the external camera 610 and the distance sensor can be used to detect the body position, posture, and shape of the user wearing the head mounted display device 600. In addition, under certain conditions, the user can directly view or preview the real scene through the external camera 610.
  • the head mounted display device 600 may further include a sound processing unit 611 that may perform sound quality correction or sound amplification of the sound signal output from the control unit 607, signal processing of the input sound signal, and the like. Then, the sound input/output unit 612 outputs the sound to the outside and the sound from the microphone after the sound processing.
  • a sound processing unit 611 may perform sound quality correction or sound amplification of the sound signal output from the control unit 607, signal processing of the input sound signal, and the like. Then, the sound input/output unit 612 outputs the sound to the outside and the sound from the microphone after the sound processing.
  • the structure or component shown by the dotted line in FIG. 6 may be independent of the head mounted display device 600, for example, may be disposed in an external processing system (eg, a computer system) for use with the head mounted display device 600; or The structure or component shown by the dashed box may be disposed inside or on the surface of the head mounted display device 600.
  • an external processing system eg, a computer system
  • Some embodiments of the present application also provide a computer storage medium storing one or more computer instructions, the one or more computer instructions being adapted to be loaded and executed by a processor to:
  • the computer storage medium further comprises: other computer instructions adapted to be loaded by the processor and to perform the operations described below:
  • At least one VR functional area is displayed, and at least one of the VR functional areas includes a video playing area;
  • the computer command that is loaded and executed by the processor and determines whether the user selects the video play area according to the point of interest of the user in the VR scenario includes:
  • the VR scene further includes a selection interaction zone associated with the video play zone.
  • the computer command that is loaded and executed by the processor and determines whether the user selects the video play area according to the point of interest of the user in the VR scenario includes:
  • the computer instructions loaded and executed by the processor in response to the operation of selecting the target video file from the plurality of video files to determine the target video file to be played include:
  • the third time length is greater than the set third time length threshold, determining that the video file corresponding to the user's point of interest is the target video file.
  • the VR scene is a 360 degree panoramic view.
  • the computer instructions loaded and executed by the processor to display a video playing interface in the VR scene include: in an arcuate area corresponding to the center of the user's perspective in the 360 degree panoramic view A screen is displayed as the video playing interface.
  • the VR scene further includes a control interaction area associated with the video play interface, the control interaction area including at least one type of play control controls.
  • the computer storage medium further includes other computer instructions adapted to be loaded by the processor and to perform the operations described below:
  • the decoder is an XBMC decoder.
  • the above-described decoder in the callable dynamic link library loaded and executed by the processor decodes the target video file into computer instructions of video data adapted to the VR scene, including:
  • the decoder is called to decode the target video file frame by frame and output the decoded video data of each frame to the frame buffer object; wherein the video data of each frame is automatically outputted to the texture object.
  • the computer instructions loaded and executed by the processor to render the video data into the video playing interface to obtain a video frame include:
  • the texture object in the rectangular window is rendered in the VR scene by calling OpenGL to output the video screen in the video playback interface.
  • the VR headset device can execute the video in the computer storage medium provided by the embodiment, and the video can be played in the VR scenario to meet the requirement of the user watching the video in the VR scenario.
  • embodiments of the present application can be provided as a method, system, or computer program product.
  • the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware.
  • the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • These computer program instructions can also be stored in a bootable computer or other programmable data processing device.
  • a computer readable memory that operates in a particular manner, causing instructions stored in the computer readable memory to produce an article of manufacture comprising an instruction device implemented in one or more flows and/or block diagrams of the flowchart The function specified in the box or in multiple boxes.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory, such as read only memory (ROM) or flash memory (flashRAM), in a computer readable medium.
  • RAM random access memory
  • ROM read only memory
  • flashRAM flash memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.
  • embodiments of the present application can be provided as a method, system, or computer program product.
  • the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment in combination of software and hardware.
  • the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供一种基于VR头戴设备播放视频的方法及VR头戴设备。其中，方法包括：通过动态链接库建立VR场景与解码器之间的通信桥梁，在VR场景中可以调用动态链接库，利用解码器将视频文件解码成与VR场景适配的视频数据，进而可以根据与VR场景适配的视频数据在VR场景中渲染出视频画面，使得可以在VR场景中播放视频，满足用户在VR场景中观看视频的需求。

Description

基于VR头戴设备播放视频的方法及VR头戴设备
交叉引用
本申请引用于2017年7月28日递交的名称为“基于VR头戴设备播放视频的方法及VR头戴设备”的第2017106310607号中国专利申请，其通过引用被全部并入本申请。
技术领域
本申请涉及三维显示技术领域，尤其涉及一种基于虚拟现实(Virtual Reality，VR)头戴设备播放视频的方法及VR头戴设备。
背景技术
Unity3D作为一款可以创作三维视频游戏、实时三维动画等的游戏引擎，因其功能强大，VR技术人员越来越倾向于使用Unity3D技术制作三维虚拟场景。在众多VR头戴设备，例如头戴显示(Helmet Mounted Display，HMD)设备中，三维虚拟场景都是使用Unity3D技术制作的。
因为3D视频更能增加用户的真实感，因此通过HMD等VR头戴设备在VR场景中播放音视频越来越引起人们的关注。为此，有必要提供一种能够在VR场景中播放视频的解决方案。
发明内容
本申请一些实施例提供一种基于VR头戴设备播放视频的方法，包括：
根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件；
响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件；
调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据；
在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
可选地，在VR场景中展示视频信息界面之前，所述方法还包括：
在所述VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区；
根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区；
当所述用户选中所述视频播放区时，确定所述用户请求观看视频。
可选地，所述根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区，包括：
基于眼球追踪技术，追踪所述用户的关注点；
当追踪到所述用户的关注点位于所述视频播放区时，记录所述用户的关注点位于所述视频播放区的第一时间长度；
当所述第一时间长度大于设定的第一时长阈值时，确定所述用户选中所述视频播放区。
可选地，所述VR场景还包括与所述视频播放区关联的一选择交互区；
所述根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区，包括：
基于眼球追踪技术，追踪所述用户的关注点；
当追踪到所述用户的关注点位于所述选择交互区时，记录所述用户的关注点位于所述选择交互区的第二时间长度；
当所述第二时间长度大于设定的第二时长阈值时，确定所述用户选中所述视频播放区。
可选地，所述响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件，包括：
基于眼球追踪技术，追踪所述用户在所述视频信息界面上的关注点；
当追踪到所述用户的关注点对应一视频文件时，记录所述用户的关注点对应所述视频文件的第三时间长度；
当所述第三时间长度大于设定的第三时长阈值时，确定所述用户的关注点对应的视频文件为所述目标视频文件。
可选地，所述VR场景为360度的全景视图；在所述VR场景中展示一视频播放界面，包括：
在所述360度的全景视图中对应所述用户的视角中心的弧形区域上展示一荧幕，作为所述视频播放界面。
可选地，所述VR场景还包括与所述视频播放界面关联的控制交互区，所述控制交互区包括至少一类播放控制控件；
在获得视频画面之后，所述方法还包括：
根据所述用户在所述VR场景中的关注点，确定所述用户从所述至少一类播放控制控件中选择的目标播放控制控件；
根据所述目标播放控制控件关联的控制事件，控制所述视频画面的播放状态。
可选地，所述解码器为XBMC解码器。
可选地，所述调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据，包括：
创建OpenGL的纹理对象，并将所述纹理对象传入所述动态链接库中；
在所述动态链接库中创建OpenGL的帧缓存对象，并将所述纹理对象附着到所述帧缓存对象上；
调用所述解码器对所述目标视频文件逐帧解码并将解码出的每帧视频数据输出至所述帧缓存对象；其中，所述每帧视频数据会自动输出到所述纹理对象上。
可选地，所述将所述视频数据渲染至所述视频播放界面中，以获得视频画面，包括：
将所述纹理对象传送至所述视频播放界面对应的矩形窗口中；
通过调用OpenGL在所述VR场景中渲染所述矩形窗口中的所述纹理对象，以在所述视频播放界面中输出所述视频画面。
本申请一些实施例还提供一种基于VR头戴设备播放视频的装置，包括：
展示模块，用于根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件；
确定模块，用于响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件；
调用模块，用于调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据；
输出模块，用于在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
可选地，所述装置还包括：判断模块；
所述展示模块，还用于在所述VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区；
所述判断模块，用于根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区；
所述确定模块，还用于在所述用户选中所述视频播放区时，确定所述用户请求观看视频。
可选地，所述判断模块具体用于：基于眼球追踪技术，追踪所述用户的关注点；当追踪到所述用户的关注点位于所述视频播放区时，记录所述用户的关注点位于所述视频播放区的第一时间长度；当所述第一时间长度大于设定的第一时长阈值时，确定所述用户选中所述视频播放区。
可选地，所述VR场景还包括与所述视频播放区关联的一选择交互区；基于此，所述判断模块具体用于：基于眼球追踪技术，追踪所述用户的关注点； 当追踪到所述用户的关注点位于所述选择交互区时，记录所述用户的关注点位于所述选择交互区的第二时间长度；当所述第二时间长度大于设定的第二时长阈值时，确定所述用户选中所述视频播放区。
可选地，所述确定模块具体用于：基于眼球追踪技术，追踪所述用户在所述视频信息界面上的关注点；当追踪到所述用户的关注点对应一视频文件时，记录所述用户的关注点对应所述视频文件的第三时间长度；当所述第三时间长度大于设定的第三时长阈值时，确定所述用户的关注点对应的视频文件为所述目标视频文件。
本申请一些实施例还提供一种VR头戴设备，包括：存储器和处理器；所述存储器，用于存储程序，所述处理器用于执行所述存储器中的所述程序，以用于：
根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件；
响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件；
调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据；
在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
可选地，所述处理器还用于：
在所述VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区；
根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区；
当所述用户选中所述视频播放区时，确定所述用户请求观看视频。
可选地，所述处理器在判断所述用户是否选中所述视频播放区时，具体用于：
基于眼球追踪技术，追踪所述用户的关注点；
当追踪到所述用户的关注点位于所述视频播放区时，记录所述用户的关注点位于所述视频播放区的第一时间长度；
当所述第一时间长度大于设定的第一时长阈值时，确定所述用户选中所述视频播放区。
可选地，所述解码器为XBMC解码器。
可选地，所述处理器在调用所述解码器时，具体用于：
创建OpenGL的纹理对象，并将所述纹理对象传入所述动态链接库中；
在所述动态链接库中创建OpenGL的帧缓存对象，并将所述纹理对象附着到所述帧缓存对象上；
调用所述解码器对所述目标视频文件逐帧解码并将解码出的每帧视频数据输出至所述帧缓存对象；其中，所述每帧视频数据会自动输出到所述纹理对象上。
在本申请实施例中，通过动态链接库建立VR场景与解码器之间的通信桥梁，利用解码器将视频文件解码成与VR场景适配的视频数据，进而可以根据与VR场景适配的视频数据在VR场景中渲染出视频画面，使得可以在VR场景中播放视频，满足用户在VR场景中观看视频的需求。
附图说明
此处所说明的附图用来提供对本申请的进一步理解，构成本申请的一部分，本申请的示意性实施例及其说明用于解释本申请，并不构成对本申请的不当限定。在附图中：
图1a为本申请一些实施例提供的基于VR头戴设备播放视频的方法流程图；
图1b为本申请另一些实施例提供的基于VR头戴设备播放视频的方法流程图；
图2a为本申请又一些实施例提供的基于VR头戴设备播放视频的方法流程；
图2b为本申请又一些实施例提供的至少一个VR功能区的一种排布样式图；
图2c为本申请又一些实施例提供的至少一个VR功能区的另一种排布样式图；
图3为本申请又一些实施例提供的基于VR头戴设备播放视频的装置结构示意图；
图4为本申请又一些实施例提供的基于VR头戴设备播放视频的装置结构示意图；
图5为本申请又一些实施例提供的VR头戴设备的结构示意图；
图6为本申请又一些实施例提供的VR头戴显示设备的内部配置结构示意图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚，下面将结合本申请具体实施例及相应的附图对本申请一些实施例中的技术方案进行描述。显然，所描述的实施例仅是本申请一部分实施例，而不是全部的实施例。基于本申请中提到的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
为满足用户在VR场景中观看视频的需求，本申请一些实施例提供一种可以在VR场景中播放视频的解决方案，主要原理是：
通过动态链接库(Dynamic Link Library，DLL)建立Unity3D开发的VR场景与解码器之间的通信桥梁，在Unity3D开发的VR场景中可以调用动态链接库，利用解码器将视频文件解码成与VR场景适配的视频数据，进而可以根据与VR场景适配的视频数据在VR场景中渲染出视频画面，使得可以在VR 场景中播放视频，满足用户在VR场景中观看视频的需求。
一些实施例中，在VR场景中播放视频之前，可以先行开发VR场景。例如，可以采用Unity3D开发VR场景。在采用Unity3D开发VR场景的过程，创建一个动态链接库，在动态链接库中实现解码器，并实现用于调用解码器的方法，这样在VR场景中就可以通过该动态链接库访问解码器，该动态链接库成为了VR场景和解码器之间的通信桥梁。当在Unity3D开发的VR场景中播放视频时，可以通过该动态链接库调用解码器将视频文件解码成与VR场景适配的视频数据，从而在VR场景中播放视频。其中，在动态链接库中实现的用于调用解码器的方法可以有多种实现，凡是可以供外部应用调用解码器的实现方法均可应用于本申请一些实施例中。一种在动态链接库中实现的用于调用解码器的方法逻辑将在后续一些实施例中进行说明，在此暂不赘述。
图1a为本申请一些实施例提供的基于VR头戴设备播放视频的方法流程图。如图1a所示，该方法包括：
10a、根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件。
10b、响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的目标视频文件。
10c、调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据。
10d、在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
在步骤10a中，用户佩戴VR头戴设备，VR头戴设备可以向用户展示VR场景。VR头戴设备会根据用户请求观看视频的请求消息在VR场景中向用户展示一视频信息界面，该视频信息界面上包括若干个视频文件，以供用户从中选择想要观看的目标视频文件。
在步骤10b中，用户可以从若干个视频文件中选择想要观看的目标视频文件。对VR头戴设备来说，可以响应于从若干个视频文件中选择目标视频文 件的操作，确定待播放的目标视频文件。
在步骤10c中，在确定目标视频文件之后，VR头戴设备可以调用动态链接库中的解码器，由解码器将目标视频文件解码成与所述VR场景适配的视频数据。
进而，在步骤10d中，VR头戴设备在VR场景中展示一视频播放界面，将解码器解码出的视频数据渲染至视频播放界面中，以获得视频画面。对用户来说，可观看VR场景中的视频播放界面正在播放的视频画面，实现在VR场景中观看视频的目的。
在本申请实施例中，并不限定解码器的类型，可以采用任何解码器，例如可以采用MediaPlayer解码器、暴风影音解码器或XBMC解码器。不同解码器所支持的视频格式有所不同，具体可根据VR场景需要支持的视频格式来选择解码器。
XBMC是一个自由和开源的(GPL)媒体中心软件，不仅能够播放几乎所有流行的音频格式和音视频格式，而且还可以播放网络媒体，支持各种网络媒体协议，支持硬件解码，支持多平台。基于此，本申请一些实施例采用XBMC解码器，从而利用XBMC支持多种音视频格式的优势，使得在Unity3D开发的VR场景中可以播放多种格式的视频文件。例如，在图1b所示实施例中，采用XBMC解码器。
图1b为本申请另一些实施例提供的基于VR头戴设备播放视频的方法流程图。如图1b所示，该方法包括：
101、根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件。
102、响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的目标视频文件。
103、调用动态链接库中的XBMC解码器将所述目标视频文件解码成与所述VR场景适配的视频数据。
104、在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所 述视频播放界面中，以获得视频画面。
在步骤101中，用户佩戴VR头戴设备，VR头戴设备可以向用户展示VR场景。值得说明的是，本申请一些实施例中的VR场景主要是指采用Unity3D实现的VR场景，为简化描述，在说明书中有些地方会直接描述成VR场景。用户可以请求在VR场景中观看视频。VR头戴设备会根据用户请求观看视频的请求消息在VR场景中向用户展示一视频信息界面，该视频信息界面上包括若干个视频文件，以供用户从中选择想要观看的目标视频文件。
在一些实施例中，视频信息界面上包括的视频文件可以是本地视频文件，也可以是基于服务信息块(Server Message Block，SMB)、通用即插即用(Universal Plug and Play，UPnP)、文件传输协议(File Transfer Protocol，FTP)等网络协议共享的视频文件。所述若干个视频文件涉及的视频格式包括Android平台支持的视频格式，例如mp4以及3gp等，也可以包括Android平台不支持的视频格式，例如wov、rmvb、rm、tb等。在采用Unity3D开发的VR场景中，结合了XBMC技术，因此用户可以选择播放各种视频格式的视频文件。
在步骤102中，用户可以从多种视频格式的视频文件中选择想要观看的视频文件。对VR头戴设备来说，可以响应于从多种视频格式的视频文件中选择视频文件的操作，确定待播放的目标视频文件。这里的目标视频文件是多种视频格式的视频文件中被选中的视频文件。在本实施例中，并不限定从多种视频格式的视频文件中选择视频文件的操作，凡是可被VR头戴设备识别的操作方式都适用于本申请。
在步骤103中，在确定目标视频文件之后，VR头戴设备可以调用动态链接库中的XBMC解码器，由XBMC解码器将目标视频文件解码成与所述VR场景适配的视频数据。
进而，在步骤104中，VR头戴设备在VR场景中展示一视频播放界面，将XBMC解码器解码出的视频数据渲染至视频播放界面中，以获得视频画面。对用户来说，可观看VR场景中的视频播放界面正在播放的视频画面，实现在 VR场景中观看视频的目的。
由此可见，在本实施例中，通过动态链接库建立Unity3D开发的VR场景与XBMC解码器之间的通信桥梁，利用XBMC解码器将视频文件解码成与VR场景适配的视频数据，进而可以根据与VR场景适配的视频数据在VR场景中渲染出视频画面，使得可以在Unity3D开发的VR场景中播放视频，满足用户在VR场景中观看视频的需求。
在一些实施例中，当用户请求在VR场景中观看视频时，VR头戴设备在VR场景中向用户展示视频信息界面。在此之前，可以先行确定用户是否请求在VR场景中观看视频。基于此，本申请另一些实施例提供的基于VR头戴设备播放视频的方法流程，如图2a所示，包括以下步骤：
200、在VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区。
用户佩戴VR头戴设备，VR头戴设备可以向用户展示VR场景。VR场景中包括至少一个VR功能区。VR功能区是指VR头戴设备可向用户提供的VR功能。例如，至少一个VR功能区中的视频播放区表示VR头戴设备可以向用户提供视频播放功能。又例如，至少一个VR功能区中的VR游戏区表示VR头戴设备可以向用户提供游戏功能。除此之外，至少一个VR功能区还可以包括用于城市规划的功能区、用于室内设计的功能区、用于工业仿真的功能区、用于教育培训的功能区等等。
一些实施例中，至少一个VR功能区可在用户的视角范围内自左向右依次排布，如图2b所示。或者，至少一个VR功能区也可以在用户的视角范围内以列表样式进行排布，如图2c所示。其中，至少一个VR功能区的排布方式并不限于图2b和图2c所示。另外，图2b和图2c所示VR场景的样式仅为一种示例，并不限于此。
201、根据用户在VR场景中的关注点，判断用户是否选择视频播放区；若判断结果为是时，执行步骤202；若判断结果为否，结束此次操作或进入其 它VR功能处理流程。
这里其它VR功能处理流程是指其它VR功能的处理流程，其它VR功能是指在视频播放区之外其它VR功能区对应的VR功能。
一些实施例中，用户可以通过转动头部和/或眼睛，从至少一个VR功能区中选择自己需要的VR功能。当用户选择VR功能时可以将双眼聚焦到该VR功能对应的VR功能区，用户双眼在VR场景中的聚焦点，即关注点。
其中，可以通过眼球追踪技术追踪用户在VR场景中的关注点。眼球追踪技术可以根据眼球和眼球周边的特征变化、虹膜角度变化、或者主动投射红外线等光束到虹膜来提取眼部特征，再根据眼部特征以及VR场景，确定用户在VR场景中的关注点。
在一些实施例中，步骤201的实施过程包括：基于眼球追踪技术，追踪用户的关注点；当追踪到用户的关注点位于视频播放区时，记录用户的关注点位于视频播放区的第一时间长度；然后判断第一时间长度是否大于设定的第一时长阈值；如果第一时间长度大于第一时长阈值，确定用户选中视频播放区。简单来说，用户可以通过注视视频播放区一定时间，从而向VR头戴设备发出选中视频播放区的指令；VR头戴设备可以根据用户的这一行为，确定用户选中视频播放区。
在一些实施例中，VR场景中除了包括至少一个VR功能区之外，还包括与各VR功能区一一对应的选择交互区。对用户来说，可通过这些选择交互区选择某一VR功能区。对视频播放区来说，用户可以通过VR场景中与视频播放区关联的选择交互区，来选择视频播放区。基于此，步骤201的实施过程包括：基于眼球追踪技术，追踪用户的关注点；当追踪到用户的关注点位于选择交互区时，记录用户的关注点位于选择交互区的第二时间长度；然后判断第二时间长度是否大于设定的第二时长阈值；如果第二时间长度大于第二时长阈值，确定用户选中视频播放区。
202、确定用户请求在VR场景中观看视频，并进入步骤203。
203、在VR场景中展示一视频信息界面，所述视频信息界面上包括若干 个视频文件。
204、响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的目标视频文件。
205、调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据。
206、在VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
在一些实施例中，所述VR场景为360度的全景视图。基于此，在上述步骤203中，可以在360度的全景视图中对应用户的视角中心的弧形区域上展示视频信息界面。这样，用户无需转动或大幅度转动头部即可看到视频信息界面，便于用户及时、快速地选择目标视频文件，进而提高视频的播放效率。
一些实施例，所述视频信息界面可以包括多个区域。例如，可以包括列表区域，用于显示各视频文件的名称。又例如，可以包括缩略图区域，用于显示各视频文件的缩略图。又例如，可以包括搜索区，用于供用户搜索视频文件，所述搜索区支持的搜索词可以是视频文件的视频格式、类型、名称、演员名、上映时间等信息。
一些实施例，在步骤10d、步骤104或步骤206中，也可以在360度的全景视图中对应用户的视角中心的弧形区域上展示一荧幕，作为视频播放界面。这样，用户无需转动或大幅度转动头部即可看到视频画面，有利于提高用户的观看体验。
在一些实施例中，在步骤10b、步骤102或步骤204中，可以根据用户的关注点，确定目标视频文件。例如，可基于眼球追踪技术，追踪用户在视频信息界面上的关注点；当追踪到所述用户的关注点对应一视频文件时，记录用户的关注点对应所述视频文件的第三时间长度；当第三时间长度大于设定的第三时长阈值时，确定用户的关注点对应的视频文件为目标视频文件。
在一些实施例中，VR头戴设备配有触控板。则在步骤10b、步骤102或步骤204中，用户可以通过转动头部和/或眼睛，从各视频文件中选择想要观 看的目标视频文件，并通过触控板发出确认选择的指令。对VR头戴设备来说，可基于眼球追踪技术，追踪用户在视频信息界面上的关注点；当追踪到所述用户的关注点对应一视频文件时，等待接收用户通过触控板发出的确认选择指令；当接收到确认选择指令时，确定用户选中其关注点对应的视频文件作为目标视频文件。
在一些实施例中，VR头戴设备配有手柄。则在步骤10b、步骤102或步骤204中，用户可以通过手柄，从各视频文件中选择自己想要观看的目标视频文件并发出确认选择的指令。对VR头戴设备来说，可以检测手柄的操作，识别手柄发出的指令，从而确定用户选中的视频文件作为目标视频文件。
在一些实施例中，步骤10c、步骤103或步骤205的一种实施方式，实际上也是在动态链接库中实现的用于调用解码器(例如XBMC解码器)的方法逻辑，包括：
在确定目标视频文件之后，首先创建OpenGL的纹理(Texture)对象，并将所述纹理对象传入动态链接库中。纹理对象主要用于存储每一帧视频动画所需的纹理数据，例如包括纹理的像素数据、纹理大小、纹理参数等信息。动态链接库在基于Unity3D开发VR场景的过程中创建。
接着，在动态链接库中创建OpenGL的帧缓存对象(Frame Buffer Object，FBO)，并将纹理对象附着到帧缓存对象上。其中，帧缓存对象可以让XBMC解码器将解码结果输出到该帧缓存对象而不是输出到屏幕上。另外，当纹理对象附着到该帧缓存对象上后，该帧缓存对象还可以将XBMC解码器的解码结果输出给该纹理对象，为在VR场景中渲染视频画面提供基础。
之后，调用解码器(例如XBMC解码器)对目标视频文件逐帧解码并将解码出的每帧视频数据输出至帧缓存对象；其中，每帧视频数据会自动输出到纹理对象上。这里每帧视频数据主要是指每帧视频动画所需的纹理数据，例如包括纹理的像素数据、纹理大小、纹理参数等信息。在本实施例中，解码器在动态链接库中实现，其整个生命周期(例如初始、循环、结束)都可 以在动态链接库中监控，便于控制解码器的运行节奏。
可选地，可以采用C++语言编写动态链接库和解码器，但不限于此。
进一步，基于上述创建的纹理对象，在步骤10d、步骤104或步骤206中，可以将上述纹理对象传送至视频播放界面对应的矩形窗口中；通过调用OpenGL在VR场景中渲染所述矩形窗口中的纹理对象，以在视频播放界面中输出所述视频画面。其中，矩形窗口是视频播放界面在VR头戴设备的屏幕上的体现，即在VR头戴设备的屏幕上创建一矩形窗口，经过渲染从而得到VR场景中的视频播放界面。
在上述过程中，不论目标视频文件是什么格式，其中每帧视频动画都会经过解码器解码到纹理对象上，通过调用OpenGL逐帧渲染纹理对象，从而可以在VR场景中看到视频画面的变化，达到在VR场景中观看视频的效果。
在一些实施例中，上述VR场景还包括与视频播放界面关联的控制交互区。可选地，控制交互区可位于视频播放界面的某个区域，例如左上角、右上角、左下角或右下角等。或者，控制交互区域位于所述VR场景中除所述视频播放界面之外的其它区域，例如视频播放界面的下方区域、左侧区域、右侧区域或上方区域等。
所述控制交互区包括至少一类播放控制控件。通过这些播放控制控件，用户可以控制视频播放界面中视频动画的播放状态。例如，至少一类播放控制控件可以包括但不限于：快进控件、暂停控件、结束控件、音量调节控件、小窗口播放控件等。基于此，在VR场景中播放视频的过程中，VR头戴设备还可以根据眼球追踪技术，追踪用户上的关注点，根据用户在VR场景中的关注点，确定所述用户从所述至少一类播放控制控件中选择的目标播放控制控件；进而根据所述目标播放控制控件关联的控制事件，控制所述视频画面的播放状态。
例如，当用户选择快进控件时，VR头戴设备可以加速视频播放界面中 的视频动画的播放速度。又例如，当用户选择暂停控件时，VR头戴设备可以暂停播放视频播放界面中的视频动画。又例如，当用户选择音量调节控件时，VR头戴设备可以增大或减小视频播放界面中的视频动画的播放音量。在本实施例中，通过控制交互区提供至少一类播放控制控件，便于用户根据自己的观看需求灵活控制视频画面的播放状态，有利于提高用户体验。
图3为本申请又一些实施例提供的基于VR头戴设备播放视频的装置结构示意图。如图3所示，所述装置包括：展示模块31、确定模块32、调用模块33和输出模块34。
展示模块31，用于根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件。可选的，VR场景可以是采用Unity3D技术开发的VR场景。
确定模块32，用于响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的目标视频文件。
调用模块33，用于调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据。
输出模块34，用于在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
在一可选实施方式中，如图4所示，所述装置还包括：判断模块35。
展示模块31，还用于在VR场景中展示视频信息界面之前，在所述VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区。相应地，判断模块35，用于根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区。确定模块32，还用于在判断模块35判断出用户选中所述视频播放区时，确定所述用户请求观看视频，进而触发展示模块31在VR场景中展示视频信息界面。
进一步可选地，判断模块35具体用于：基于眼球追踪技术，追踪所述用户的关注点；当追踪到所述用户的关注点位于所述视频播放区时，记录所述 用户的关注点位于所述视频播放区的第一时间长度；当所述第一时间长度大于设定的第一时长阈值时，确定所述用户选中所述视频播放区。
进一步可选地，VR场景还包括与所述视频播放区关联的一选择交互区。基于此，判断模块35具体用于：基于眼球追踪技术，追踪所述用户的关注点；当追踪到所述用户的关注点位于所述选择交互区时，记录所述用户的关注点位于所述选择交互区的第二时间长度；当所述第二时间长度大于设定的第二时长阈值时，确定所述用户选中所述视频播放区。
在一可选实施方式中，确定模块32在响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的目标视频文件时，具体用于：基于眼球追踪技术，追踪所述用户在所述视频信息界面上的关注点；当追踪到所述用户的关注点对应一视频文件时，记录所述用户的关注点对应所述视频文件的第三时间长度；当所述第三时间长度大于设定的第三时长阈值时，确定所述用户的关注点对应的视频文件为所述目标视频文件。
在一可选实施方式中，所述VR场景为360度的全景视图；输出模块34在所述VR场景中展示一视频播放界面时，具体用于：在所述360度的全景视图中对应所述用户的视角中心的弧形区域上展示一荧幕，作为所述视频播放界面。
在一可选实施方式中，解码器可以是XBMC解码器，但不限于此。
在一可选实施方式中，调用模块33具体用于：创建OpenGL的纹理对象，并将所述纹理对象传入所述动态链接库中；在所述动态链接库中创建OpenGL的帧缓存对象，并将所述纹理对象附着到所述帧缓存对象上；调用所述解码器对所述目标视频文件逐帧解码并将解码出的每帧视频数据输出至所述帧缓存对象；其中，所述每帧视频数据会自动输出到所述纹理对象上。
在一可选实施方式中，输出模块34在将所述视频数据渲染至所述视频播放界面中，以获得视频画面时，具体用于：将所述纹理对象传送至所述视频播放界面对应的矩形窗口中；通过调用OpenGL在所述VR场景中渲染所述矩形窗口中的所述纹理对象，以在所述视频播放界面中输出所述视频画面。
在一可选实施方式中，所述VR场景还包括与所述视频播放界面关联的控制交互区，所述控制交互区包括至少一类播放控制控件。基于此，输出模块34还用于在将所述视频数据渲染至所述视频播放界面中，以获得视频画面之后，根据所述用户在所述VR场景中的关注点，确定所述用户从所述至少一类播放控制控件中选择的目标播放控制控件；根据所述目标播放控制控件关联的控制事件，控制所述视频画面的播放状态。
本实施例提供的装置，可用于执行上述实施例提供的基于VR头戴设备播放视频的方法流程，其具体工作原理不再赘述，详见方法实施例的描述。
本实施例提供的基于VR头戴设备播放视频的装置，通过动态链接库建立VR场景与解码器之间的通信桥梁，利用解码器将视频文件解码成与VR场景适配的视频数据，进而可以根据与VR场景适配的视频数据在VR场景中渲染出视频画面，使得可以在VR场景中播放视频，满足用户在VR场景中观看视频的需求。
如图5所示，本申请一些实施例提供一种VR头戴设备。该VR头戴设备可以包括存储器51和处理器52。
其中，存储器51主要用于存储程序。除存储程序之外，存储器51还可被配置为存储其它各种数据以支持在VR头戴设备上的操作。其它各种数据的示例包括程序数据、消息，图片等。
存储器51可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
处理器52用于执行存储器51中存储的程序，以用于：
根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件；
响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件；
调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据；
在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
在一可选实施方式中，处理器52在VR场景中展示视频信息界面之前，还用于：
在所述VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区；
根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区；
当所述用户选中所述视频播放区时，确定所述用户请求观看视频。
在一可选实施方式中，处理器52在根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区时，具体用于：
基于眼球追踪技术，追踪所述用户的关注点；
当追踪到所述用户的关注点位于所述视频播放区时，记录所述用户的关注点位于所述视频播放区的第一时间长度；
当所述第一时间长度大于设定的第一时长阈值时，确定所述用户选中所述视频播放区。
在一可选实施方式中，所述VR场景还包括与所述视频播放区关联的一选择交互区。基于此，处理器52在根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区时，具体用于：
基于眼球追踪技术，追踪所述用户的关注点；
当追踪到所述用户的关注点位于所述选择交互区时，记录所述用户的关注点位于所述选择交互区的第二时间长度；
当所述第二时间长度大于设定的第二时长阈值时，确定所述用户选中所述视频播放区。
在一可选实施方式中，处理器52在响应于从所述若干个视频文件中选择 目标视频文件的操作，确定待播放的所述目标视频文件时，具体用于：
基于眼球追踪技术，追踪所述用户在所述视频信息界面上的关注点；
当追踪到所述用户的关注点对应一视频文件时，记录所述用户的关注点对应所述视频文件的第三时间长度；
当所述第三时间长度大于设定的第三时长阈值时，确定所述用户的关注点对应的视频文件为所述目标视频文件。
在一可选实施方式中，所述VR场景为360度的全景视图。基于此，处理器52在所述VR场景中展示视频播放界面时，具体用于：在所述360度的全景视图中对应所述用户的视角中心的弧形区域上展示一荧幕，作为所述视频播放界面。
在一可选实施方式中，所述VR场景还包括与所述视频播放界面关联的控制交互区，所述控制交互区包括至少一类播放控制控件。基于此，处理器52还用于：在获得视频画面之后，根据所述用户在所述VR场景中的关注点，确定所述用户从所述至少一类播放控制控件中选择的目标播放控制控件；根据所述目标播放控制控件关联的控制事件，控制所述视频画面的播放状态。
在一可选实施方式中，所述解码器为XBMC解码器，但不限于此。
在一可选实施方式中，处理器52在调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据时，具体用于：
创建OpenGL的纹理对象，并将所述纹理对象传入所述动态链接库中；
在所述动态链接库中创建OpenGL的帧缓存对象，并将所述纹理对象附着到所述帧缓存对象上；
调用所述解码器对所述目标视频文件逐帧解码并将解码出的每帧视频数据输出至所述帧缓存对象；其中，所述每帧视频数据会自动输出到所述纹理对象上。
在一可选实施方式中，处理器52在将所述视频数据渲染至所述视频播放界面中，以获得视频画面时，具体用于：
将所述纹理对象传送至所述视频播放界面对应的矩形窗口中；
通过调用OpenGL在所述VR场景中渲染所述矩形窗口中的所述纹理对象，以在所述视频播放界面中输出所述视频画面。
如图5所示，VR头戴设备除了包括存储器51和处理器52之外，还可以包括显示屏53、双目透镜(Lens)54、惯性检测单元(Inertial Measurement Unit，IMU)55、扬声器56等组件。图5中仅示出VR头戴设备的部分组件，并不是全部组件，本领域技术人员可以理解VR头戴设备除图5所示组件之外还可以包括其他组件，当然，也可以选择不包括图5示出的一些组件。
可选地，显示屏53可以采用LED显示屏，但不限于此。IMU55可以包括陀螺仪、磁力计、加速度计等。
采用本实施例提供的VR头戴设备可以在VR场景中播放视频，满足用户在VR场景中观看视频的需求。
本发明一些实施例提供的电子设备可以为外接式头戴显示设备或者一体式头戴显示设备，其中外接式头戴显示设备需要与外部处理系统(例如计算机处理系统)配合使用。
图6示出了一些实施例中头戴显示设备600的内部配置结构示意图。
显示单元601可以包括显示面板，显示面板设置在头戴显示设备600上面向用户面部的侧表面，可以为一整块面板、或者为分别对应用户左眼和右眼的左面板和右面板。显示面板可以为电致发光(EL)元件、液晶显示器或具有类似结构的微型显示器、或者视网膜可直接显示或类似的激光扫描式显示器。
虚拟图像光学单元602以放大方式拍摄显示单元601所显示的图像，并允许用户按放大的虚拟图像观察所显示的图像。作为输出到显示单元601上的显示图像，可以是从内容再现设备(蓝光光碟或DVD播放器)或流媒体服务器提供的虚拟场景的图像、或者使用外部相机610拍摄的现实场景的图像。一些实施例中，虚拟图像光学单元602可以包括透镜单元，例如球面透镜、非球面透镜、菲涅尔透镜等。
输入操作单元603包括至少一个用来执行输入操作的操作部件，例如按 键、按钮、开关或者其他具有类似功能的部件，通过操作部件接收用户指令，并且向控制单元607输出指令。
状态信息获取单元604用于获取穿戴头戴显示设备600的用户的状态信息。状态信息获取单元604可以包括各种类型的传感器，用于自身检测状态信息，并可以通过通信单元605从外部设备(例如智能手机、腕表和用户穿戴的其它多功能终端)获取状态信息。状态信息获取单元604可以获取用户的头部的位置信息和/或姿态信息。状态信息获取单元604可以包括陀螺仪传感器、加速度传感器、全球定位系统(GPS)传感器、地磁传感器、多普勒效应传感器、红外传感器、射频场强度传感器中的一个或者多个。此外，状态信息获取单元604获取穿戴头戴显示设备600的用户的状态信息，例如获取例如用户的操作状态(用户是否穿戴头戴显示设备600)、用户的动作状态(诸如静止、行走、跑动和诸如此类的移动状态，手或指尖的姿势、眼睛的开或闭状态、视线方向、瞳孔尺寸)、精神状态(用户是否沉浸在观察所显示的图像以及诸如此类的)，甚至生理状态。
通信单元605执行与外部装置的通信处理、调制和解调处理、以及通信信号的编码和解码处理。另外，控制单元607可以从通信单元605向外部装置发送传输数据。通信方式可以是有线或者无线形式，例如移动高清链接(MHL)或通用串行总线(USB)、高清多媒体接口(HDMI)、无线保真(Wi-Fi)、蓝牙通信或低功耗蓝牙通信，以及IEEE802.11s标准的网状网络等。另外，通信单元605可以是根据宽带码分多址(W-CDMA)、长期演进(LTE)和类似标准操作的蜂窝无线收发器。
一些实施例中，头戴显示设备600还可以包括存储单元，存储单元606是配置为具有固态驱动器(SSD)等的大容量存储设备。一些实施例中，存储单元606可以存储应用程序或各种类型的数据。例如，用户使用头戴显示设备600观看的内容可以存储在存储单元606中。
一些实施例中，头戴显示设备600还可以包括控制单元，控制单元607可以包括计算机处理单元(CPU)或者其他具有类似功能的设备。一些实施 例中，控制单元607可以用于执行存储单元606存储的应用程序，或者控制单元607还可以用于执行本申请一些实施例公开的方法、功能和操作的电路。
图像处理单元608用于执行信号处理，比如与从控制单元607输出的图像信号相关的图像质量校正，以及将其分辨率转换为根据显示单元601的屏幕的分辨率。然后，显示驱动单元609依次选择显示单元601的每行像素，并逐行依次扫描显示单元601的每行像素，因而提供基于经信号处理的图像信号的像素信号。
一些实施例中，头戴显示设备600还可以包括外部相机。外部相机610可以设置在头戴显示设备600主体前表面，外部相机610可以为一个或者多个。外部相机610可以获取三维信息，并且也可以用作距离传感器。另外，探测来自物体的反射信号的位置灵敏探测器(PSD)或者其他类型的距离传感器可以与外部相机610一起使用。外部相机610和距离传感器可以用于检测穿戴头戴显示设备600的用户的身体位置、姿态和形状。另外，一定条件下用户可以通过外部相机610直接观看或者预览现实场景。
一些实施例中，头戴显示设备600还可以包括声音处理单元，声音处理单元611可以执行从控制单元607输出的声音信号的声音质量校正或声音放大，以及输入声音信号的信号处理等。然后，声音输入/输出单元612在声音处理后向外部输出声音以及输入来自麦克风的声音。
需要说明的是，图6中虚线框示出的结构或部件可以独立于头戴显示设备600之外，例如可以设置在外部处理系统(例如计算机系统)中与头戴显示设备600配合使用；或者，虚线框示出的结构或部件可以设置在头戴显示设备600内部或者表面上。
本申请一些实施例还提供一种计算机存储介质，所述计算机存储介质存储有一条或多条计算机指令，所述一条或多条计算机指令适于由处理器加载并执行，以实现：
根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件；
响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件；
调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据；
在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
在一些实施例中，所述计算机存储介质还包括：适于被所述处理器加载并执行实现下述操作的其它计算机指令：
在所述VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区；
根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区；
当所述用户选中所述视频播放区时，确定所述用户请求观看视频。
在一些实施例中，上述由处理器加载并执行的可根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区的计算机指令，包括：
基于眼球追踪技术，追踪所述用户的关注点；
当追踪到所述用户的关注点位于所述视频播放区时，记录所述用户的关注点位于所述视频播放区的第一时间长度；
当所述第一时间长度大于设定的第一时长阈值时，确定所述用户选中所述视频播放区。
在一些实施例中，所述VR场景还包括与所述视频播放区关联的一选择交互区。基于此，上述由处理器加载并执行的可根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区的计算机指令，包括：
基于眼球追踪技术，追踪所述用户的关注点；
当追踪到所述用户的关注点位于所述选择交互区时，记录所述用户的关 注点位于所述选择交互区的第二时间长度；
当所述第二时间长度大于设定的第二时长阈值时，确定所述用户选中所述视频播放区。
在一些实施例中，上述由处理器加载并执行的可响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件的计算机指令，包括：
基于眼球追踪技术，追踪所述用户在所述视频信息界面上的关注点；
当追踪到所述用户的关注点对应一视频文件时，记录所述用户的关注点对应所述视频文件的第三时间长度；
当所述第三时间长度大于设定的第三时长阈值时，确定所述用户的关注点对应的视频文件为所述目标视频文件。
在一些实施例中，所述VR场景为360度的全景视图。基于此，上述由处理器加载并执行的可在所述VR场景中展示一视频播放界面的计算机指令，包括：在所述360度的全景视图中对应所述用户的视角中心的弧形区域上展示一荧幕，作为所述视频播放界面。
在一些实施例中，所述VR场景还包括与所述视频播放界面关联的控制交互区，所述控制交互区包括至少一类播放控制控件。基于此，所述计算机存储介质还包括：适于由处理器加载并执行实现下述操作的其它计算机指令：
根据所述用户在所述VR场景中的关注点，确定所述用户从所述至少一类播放控制控件中选择的目标播放控制控件；
根据所述目标播放控制控件关联的控制事件，控制所述视频画面的播放状态。
在一些实施例中，所述解码器为XBMC解码器。
在一些实施例中，上述由处理器加载并执行的可调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据的计算机指令，包括：
创建OpenGL的纹理对象，并将所述纹理对象传入所述动态链接库中；
在所述动态链接库中创建OpenGL的帧缓存对象，并将所述纹理对象附着到所述帧缓存对象上；
调用所述解码器对所述目标视频文件逐帧解码并将解码出的每帧视频数据输出至所述帧缓存对象；其中，所述每帧视频数据会自动输出到所述纹理对象上。
在一些实施例中，上述由处理器加载并执行的可将所述视频数据渲染至所述视频播放界面中，以获得视频画面的计算机指令，包括：
将所述纹理对象传送至所述视频播放界面对应的矩形窗口中；
通过调用OpenGL在所述VR场景中渲染所述矩形窗口中的所述纹理对象，以在所述视频播放界面中输出所述视频画面。
通过VR头戴设备执行本实施例提供的计算机存储介质中的计算机指令，可以在VR场景中播放视频，满足用户在VR场景中观看视频的需求。
本领域内的技术人员应明白，本申请的实施例可提供为方法、系统、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设 备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
在一个典型的配置中，计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。
内存可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flashRAM)。内存是计算机可读介质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括，但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带，磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质，可用于存储可以被计算设备访问的信息。按照本文中的界定，计算机可读介质不包括暂存电脑可读媒体(transitory media)，如调制的数据信号和载波。
还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下，由 语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。
本领域技术人员应明白，本申请的实施例可提供为方法、系统或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
以上所述仅为本申请的实施例而已，并不用于限制本申请。对于本领域技术人员来说，本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等，均应包含在本申请的权利要求范围之内。

Claims (15)

  1. 一种基于VR头戴设备播放视频的方法，其特征在于，包括：
    根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件；
    响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件；
    调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据；
    在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
  2. 根据权利要求1所述的方法，其特征在于，在VR场景中展示视频信息界面之前，所述方法还包括：
    在所述VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区；
    根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区；
    当所述用户选中所述视频播放区时，确定所述用户请求观看视频。
  3. 根据权利要求2所述的方法，其特征在于，所述根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区，包括：
    基于眼球追踪技术，追踪所述用户的关注点；
    当追踪到所述用户的关注点位于所述视频播放区时，记录所述用户的关注点位于所述视频播放区的第一时间长度；
    当所述第一时间长度大于设定的第一时长阈值时，确定所述用户选中所述视频播放区。
  4. 根据权利要求2所述的方法，其特征在于，所述VR场景还包括与所述视频播放区关联的一选择交互区；
    所述根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区，包括：
    基于眼球追踪技术，追踪所述用户的关注点；
    当追踪到所述用户的关注点位于所述选择交互区时，记录所述用户的关注点位于所述选择交互区的第二时间长度；
    当所述第二时间长度大于设定的第二时长阈值时，确定所述用户选中所述视频播放区。
  5. 根据权利要求1所述的方法，其特征在于，所述响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件，包括：
    基于眼球追踪技术，追踪所述用户在所述视频信息界面上的关注点；
    当追踪到所述用户的关注点对应一视频文件时，记录所述用户的关注点对应所述视频文件的第三时间长度；
    当所述第三时间长度大于设定的第三时长阈值时，确定所述用户的关注点对应的视频文件为所述目标视频文件。
  6. 根据权利要求1所述的方法，其特征在于，所述VR场景为360度的全景视图；在所述VR场景中展示一视频播放界面，包括：
    在所述360度的全景视图中对应所述用户的视角中心的弧形区域上展示一荧幕，作为所述视频播放界面。
  7. 根据权利要求1所述的方法，其特征在于，所述VR场景还包括与所述视频播放界面关联的控制交互区，所述控制交互区包括至少一类播放控制控件；
    在获得视频画面之后，所述方法还包括：
    根据所述用户在所述VR场景中的关注点，确定所述用户从所述至少一类播放控制控件中选择的目标播放控制控件；
    根据所述目标播放控制控件关联的控制事件，控制所述视频画面的播放状态。
  8. 根据权利要求1所述的方法，其特征在于，所述解码器为XBMC解码器。
  9. 根据权利要求1-8任一项所述的方法，其特征在于，所述调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据，包括：
    创建OpenGL的纹理对象，并将所述纹理对象传入所述动态链接库中；
    在所述动态链接库中创建OpenGL的帧缓存对象，并将所述纹理对象附着到所述帧缓存对象上；
    调用所述解码器对所述目标视频文件逐帧解码并将解码出的每帧视频数据输出至所述帧缓存对象；其中，所述每帧视频数据会自动输出到所述纹理对象上。
  10. 根据权利要求9所述的方法，其特征在于，所述将所述视频数据渲染至所述视频播放界面中，以获得视频画面，包括：
    将所述纹理对象传送至所述视频播放界面对应的矩形窗口中；
    通过调用OpenGL在所述VR场景中渲染所述矩形窗口中的所述纹理对象，以在所述视频播放界面中输出所述视频画面。
  11. 一种VR头戴设备，其特征在于，包括：存储器和处理器；
    所述存储器，用于存储程序；
    所述处理器，用于执行所述存储器中的所述程序，以用于：
    根据用户请求观看视频的请求消息，在VR场景中展示视频信息界面，所述视频信息界面上包括若干个视频文件；
    响应于从所述若干个视频文件中选择目标视频文件的操作，确定待播放的所述目标视频文件；
    调用动态链接库中的解码器将所述目标视频文件解码成与所述VR场景适配的视频数据；
    在所述VR场景中展示一视频播放界面，将所述视频数据渲染至所述视频播放界面中，以获得视频画面。
  12. 根据权利要求11所述的VR头戴设备，其特征在于，所述处理器还用于：
    在所述VR场景中，展示至少一个VR功能区，至少一个所述VR功能区包括视频播放区；
    根据所述用户在所述VR场景中的关注点，判断所述用户是否选中所述视频播放区；
    当所述用户选中所述视频播放区时，确定所述用户请求观看视频。
  13. 根据权利要求12所述的VR头戴设备，其特征在于，所述处理器在判断所述用户是否选中所述视频播放区时，具体用于：
    基于眼球追踪技术，追踪所述用户的关注点；
    当追踪到所述用户的关注点位于所述视频播放区时，记录所述用户的关注点位于所述视频播放区的第一时间长度；
    当所述第一时间长度大于设定的第一时长阈值时，确定所述用户选中所述视频播放区。
  14. 根据权利要求11所述的VR头戴设备，其特征在于，所述解码器为XBMC解码器。
  15. 根据权利要求11-14任一项所述的VR头戴设备，其特征在于，所述处理器在调用所述解码器时，具体用于：
    创建OpenGL的纹理对象，并将所述纹理对象传入所述动态链接库中；
    在所述动态链接库中创建OpenGL的帧缓存对象，并将所述纹理对象附着到所述帧缓存对象上；
    调用所述解码器对所述目标视频文件逐帧解码并将解码出的每帧视频数据输出至所述帧缓存对象；其中，所述每帧视频数据会自动输出到所述纹理对象上。
PCT/CN2017/098115 2017-07-28 2017-08-18 基于vr头戴设备播放视频的方法及vr头戴设备 Ceased WO2019019232A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710631060.7A CN107396086A (zh) 2017-07-28 2017-07-28 基于vr头戴设备播放视频的方法及vr头戴设备
CN201710631060.7 2017-07-28

Publications (1)

Publication Number Publication Date
WO2019019232A1 true WO2019019232A1 (zh) 2019-01-31

Family

ID=60341383

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/098115 Ceased WO2019019232A1 (zh) 2017-07-28 2017-08-18 基于vr头戴设备播放视频的方法及vr头戴设备

Country Status (2)

Country Link
CN (1) CN107396086A (zh)
WO (1) WO2019019232A1 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3955584B1 (en) * 2018-04-11 2024-07-10 Alcacruz Inc. Digital media system
CN108668168B (zh) * 2018-05-28 2020-10-09 烽火通信科技股份有限公司 基于Unity 3D的安卓VR视频播放器及其设计方法
CN109491508B (zh) * 2018-11-27 2022-08-26 北京七鑫易维信息技术有限公司 一种确定注视对象的方法和装置
CN110290409A (zh) * 2019-07-26 2019-09-27 浙江开奇科技有限公司 数据处理方法、vr设备以及系统
CN112037341A (zh) * 2020-08-26 2020-12-04 北京掌中飞天科技股份有限公司 基于Web前端处理VR全景交互功能的方法及装置
CN114615528B (zh) * 2020-12-03 2024-04-19 中移(成都)信息通信科技有限公司 Vr视频的播放方法、系统、设备及介质
CN113181653B (zh) * 2021-05-28 2025-08-12 努比亚技术有限公司 一种游戏画面处理方法、设备及计算机可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104596523A (zh) * 2014-06-05 2015-05-06 腾讯科技（深圳）有限公司 一种街景目的地引导方法和设备
CN105872515A (zh) * 2015-01-23 2016-08-17 上海乐相科技有限公司 一种视频播放控制方法及装置
US20170109936A1 (en) * 2015-10-20 2017-04-20 Magic Leap, Inc. Selecting virtual objects in a three-dimensional space
CN106796351A (zh) * 2014-09-18 2017-05-31 爱父爱斯吉尔有限公司 通过视线控制的头戴式显示装置及其控制方法、用于控制该装置的计算机程序
CN106973569A (zh) * 2014-05-13 2017-07-21 Pcp虚拟现实股份有限公司 生成和回放虚拟现实多媒体的方法、系统和装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5452537B2 (ja) * 2011-04-04 2014-03-26 日立コンシューマエレクトロニクス株式会社 映像表示システム及び表示装置
US9135371B2 (en) * 2011-05-09 2015-09-15 Google Inc. Contextual video browsing
CN106020461A (zh) * 2016-05-13 2016-10-12 陈盛胜 基于眼球追踪技术的视频交互方法
CN106131539A (zh) * 2016-06-30 2016-11-16 乐视控股（北京）有限公司 一种虚拟现实vr设备及其视频播放方法
CN106527857A (zh) * 2016-10-10 2017-03-22 成都斯斐德科技有限公司 一种基于虚拟现实的全景视频交互方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106973569A (zh) * 2014-05-13 2017-07-21 Pcp虚拟现实股份有限公司 生成和回放虚拟现实多媒体的方法、系统和装置
CN104596523A (zh) * 2014-06-05 2015-05-06 腾讯科技（深圳）有限公司 一种街景目的地引导方法和设备
CN106796351A (zh) * 2014-09-18 2017-05-31 爱父爱斯吉尔有限公司 通过视线控制的头戴式显示装置及其控制方法、用于控制该装置的计算机程序
CN105872515A (zh) * 2015-01-23 2016-08-17 上海乐相科技有限公司 一种视频播放控制方法及装置
US20170109936A1 (en) * 2015-10-20 2017-04-20 Magic Leap, Inc. Selecting virtual objects in a three-dimensional space

Also Published As

Publication number Publication date
CN107396086A (zh) 2017-11-24

Similar Documents

Publication Publication Date Title
US12401773B2 (en) Methods and system for generating and displaying 3D videos in a virtual, augmented, or mixed reality environment
US11380362B2 (en) Spherical video editing
WO2019019232A1 (zh) 基于vr头戴设备播放视频的方法及vr头戴设备
RU2719454C1 (ru) Системы и способы для создания, трансляции и просмотра 3d-контента
JP6708689B2 (ja) 三次元ゲームプレイの共有
US10497175B2 (en) Augmented reality virtual monitor
US9594537B2 (en) Executable virtual objects associated with real objects
CN103608716B (zh) 体视频呈现
KR20210046760A (ko) 비디오 클립 객체 추적
KR20170073216A (ko) 촬영 디바이스 및 그 제어 방법
CN109314800B (zh) 用于将用户注意力引导到基于位置的游戏进行伴随应用的方法和系统
WO2019015249A1 (zh) 基于虚拟现实的图像显示方法和装置、虚拟现实头盔设备
JP2017208676A (ja) 仮想空間を提供する方法、プログラム及び記録媒体
CN109696959B (zh) 一种画面展示方法、设备及存储介质
WO2023090038A1 (ja) 情報処理装置、映像処理方法、プログラム
US20230344973A1 (en) Variable audio for audio-visual content
JP2017208808A (ja) 仮想空間を提供する方法、プログラム及び記録媒体
KR20250025757A (ko) 더블 카메라 스트림들
WO2019085109A1 (zh) 图像写入控制方法、装置及电子设备
US11025921B1 (en) Providing a virtual view by streaming serialized data
KR102889724B1 (ko) 가상공간 촬영장치 및 촬영방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17919185

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17919185

Country of ref document: EP

Kind code of ref document: A1