WO2017198143A1 - 视频处理方法、视频播放方法、机顶盒以及vr设备 - Google Patents

视频处理方法、视频播放方法、机顶盒以及vr设备 Download PDF

Info

Publication number
WO2017198143A1
WO2017198143A1 PCT/CN2017/084541 CN2017084541W WO2017198143A1 WO 2017198143 A1 WO2017198143 A1 WO 2017198143A1 CN 2017084541 W CN2017084541 W CN 2017084541W WO 2017198143 A1 WO2017198143 A1 WO 2017198143A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
field
view
video
top box
Prior art date
Application number
PCT/CN2017/084541
Other languages
English (en)
French (fr)
Inventor
刘振宇
何冰
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017198143A1 publication Critical patent/WO2017198143A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42653—Internal components of the client ; Characteristics thereof for processing graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen

Definitions

  • the present application relates to, but is not limited to, the field of video, and in particular, to a video processing method, a video playing method, a set top box, and a VR device.
  • the digital TV system is still the main role of the TV program providing service.
  • the live TV broadcast and the first broadcast of the TV series are still prioritized on the digital TV network.
  • DVB Digital Video Broadcasting, Digital Video Broadcasting
  • the playback of panoramic video requires a large amount of data transmission, and the VR device needs to download the panoramic video to the local.
  • a large amount of data transmission requires a good network environment and a large bandwidth.
  • playback jams and resolution decrease may occur, which may affect the user experience.
  • the embodiments of the present invention provide a video processing method, a video playing method, a set-top box, and a VR device, so as to at least solve the problem that the amount of data that needs to be transmitted when the VR device plays video in the related art is too large.
  • a video processing method comprising: parsing an image of a frame from received video data; receiving information provided by a VR device, wherein the information is used to calculate usage of the VR device a field of view; extracting an image within the field of view from the image based on the information; transmitting an image within the field of view to the VR device.
  • extracting an image within the field of view from the image according to the information, and transmitting the image within the field of view to the VR device may include: according to the information from the An image in the field of view is intercepted in the image; a resolution of an edge of the image in the field of view is reduced; and an image in the field of view with reduced resolution is transmitted to the VR device.
  • extracting an image within the field of view from the image according to the information may include: dividing an edge of an image within the field of view according to a range of a sensitive area of a human eye.
  • parsing the image of the frame from the received video data may include: acquiring a left eye video and a right eye video in the video data, and from the left eye video and the right eye video Parsing an image corresponding to the frame respectively;
  • Extracting the image within the field of view from the image according to the information may include extracting an image within the field of view from an image corresponding to the left eye video and an image corresponding to the right eye video, respectively.
  • transmitting the image in the field of view to the VR device may include: in the case that the VR device has only one screen, the left eye video corresponds to the field of view And the image in the field of view corresponding to the right eye video is combined left and right; and the image in the field of view after the combination is sent to the VR device.
  • transmitting the image in the field of view to the VR device may include: in a case where the VR device has two screens, the left eye video corresponds to the field of view The image and the image in the field of view corresponding to the right eye video are respectively sent to the VR device.
  • the information provided by the VR device may include at least one of: a visual distance of the VR device, an axial angle of the VR device, and a location of the VR device.
  • transmitting the image within the field of view to the VR device may include transmitting an image within the field of view to the VR device via Wireless Fidelity (WIFI).
  • WIFI Wireless Fidelity
  • a video playing method including: and a set top box Establishing a connection; transmitting information to the set top box, wherein the information is used to calculate a field of view using the VR device; receiving an image within the field of view from the set top box; playing an image within the field of view.
  • receiving an image in the field of view range from the set top box may include: receiving, from the set top box, an image within the field of view corresponding to a left eye video and a range of the field of view corresponding to a right eye video Image;
  • Playing the image in the field of view may include: playing the image in the field of view corresponding to the left eye video and the image in the field of view corresponding to the right eye video to perform left and right combination; or The image in the field of view corresponding to the left eye video and the image in the field of view corresponding to the right eye video are respectively played in two screens.
  • the information transmitted to the set top box may include at least one of: a visual distance of the VR device, an axial angle of the VR device, a location of the VR device.
  • receiving an image within the field of view from the set top box may include receiving an image within the field of view from the set top box via WIFI.
  • a set top box comprising: a receiving module configured to parse an image of a frame from the received video data; and a first wireless communication module configured to receive information provided by the VR device, wherein The information is used to calculate a field of view using the VR device; the video processing module is configured to extract an image in the field of view from the image according to the information; and the second wireless communication module is configured to An image within the field of view is sent to the VR device.
  • the video processing module may be configured to intercept an image within the field of view from the image according to the information, and reduce a resolution of an edge of the image within the field of view;
  • the second wireless communication module can be configured to transmit an image within the field of view with reduced resolution to the VR device.
  • the video processing module is configured to divide an edge of an image within the field of view according to a range of a human eye sensitive area.
  • the receiving module may be configured to acquire the video data a left-eye video and a right-eye video, and respectively parsing an image corresponding to the frame from the left-eye video and the right-eye video;
  • the video processing module may be configured as an image corresponding to the left-eye video respectively An image within the field of view is extracted from an image corresponding to the right eye video.
  • the second wireless communication module may be configured to map an image within the field of view corresponding to the left eye video and the right eye The image in the field of view corresponding to the video is combined left and right; the image in the field of view after the combination is sent to the VR device.
  • the second wireless communication module may be configured to map an image within the field of view corresponding to the left eye video and the right eye The images in the field of view corresponding to the video are respectively sent to the VR device.
  • the information provided by the VR device may include at least one of: a visual distance of the VR device, an axial angle of the VR device, and a location of the VR device.
  • the second wireless communication module may be configured to transmit an image within the field of view to the VR device via WIFI.
  • a VR device including: a third wireless communication module configured to establish a connection with a set top box; and a fourth wireless communication module configured to send information to the set top box, wherein the information
  • a fifth wireless communication module configured to receive an image within the field of view from the set top box, and a video playback module configured to play an image within the field of view.
  • the fifth wireless communication module may be configured to receive, from the set top box, an image within the field of view corresponding to a left eye video and an image within the field of view corresponding to a right eye video;
  • the video playing module may be configured to play the image in the field of view corresponding to the left eye video and the image in the field of view corresponding to the right eye video, and then play it; or, in two screens Playing the image in the field of view corresponding to the left eye video and the image in the field of view corresponding to the right eye video respectively.
  • the VR device may further include: a location acquisition module configured to acquire a visual distance of the VR device, an axial angle of the VR device, and a location of the VR device.
  • the fifth wireless communication module may be configured to receive an image within the field of view from the set top box via WIFI.
  • the embodiment of the present application further provides a machine readable medium storing a computer executable program, and the computer executable program is implemented by a processor to implement the video processing method described above.
  • the embodiment of the present application further provides a machine readable medium storing a computer executable program, where the computer executable program is executed by a processor to implement the video playing method described above.
  • the VR device provides information for calculating the field of view range
  • the field of view of the VR device is calculated according to the information, and the image of the frame is parsed from the received video data according to the field of view of the VR device. Extracting the image in the field of view, the amount of data in the field of view is only a small part of the amount of data of the original image, which greatly reduces the amount of data sent to the VR device, and the amount of data received by the VR device is correspondingly reduced.
  • the invention solves the problem that the amount of data that needs to be transmitted when the VR device plays video in the related art is too large, and achieves the technical effect of improving the smoothness of the video played by the VR device.
  • FIG. 1 is a block diagram showing the hardware structure of a mobile terminal that executes a video processing method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of a video processing method according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of a method for processing a panoramic video according to an embodiment of the present invention
  • FIG. 4 is a flow chart of interaction between a VR device and a set top box according to an embodiment of the present invention
  • FIG. 5 is an interaction diagram between a broadcast video source, a digital set top box, and a VR device according to an embodiment of the present invention
  • FIG. 6 is a flow chart of still another method of processing a panoramic video according to an embodiment of the present invention.
  • FIG. 7 is a flowchart of a video playing method according to an embodiment of the present invention.
  • FIG. 8 is a flow chart of still another method of processing a panoramic video according to an embodiment of the present invention.
  • FIG. 9 is a block diagram showing the structure of a set top box according to an embodiment of the present invention.
  • FIG. 10 is a structural block diagram of a VR device according to an embodiment of the present invention.
  • FIG. 1 is a hardware structural block diagram of a mobile terminal performing a video processing method according to an embodiment of the present invention.
  • mobile terminal 10 may include one or more (only one shown) processor 102 (processor 102 may include, but is not limited to, a microprocessor (MCU) or a programmable logic device (FPGA), etc. Processing device), memory 104 for storing data, and transmission device 106 for communication functions.
  • processor 102 may include, but is not limited to, a microprocessor (MCU) or a programmable logic device (FPGA), etc. Processing device
  • memory 104 for storing data
  • transmission device 106 for communication functions.
  • the structure shown in FIG. 1 is merely illustrative and does not limit the structure of the above electronic device.
  • the mobile terminal 10 may also include more or fewer components than those shown in FIG. 1, or have a different configuration than that shown in FIG.
  • the memory 104 can be used to store software programs and modules of application software, such as program instructions or modules corresponding to the video processing method in the embodiment of the present invention, and the processor 102 executes various programs by running software programs and modules stored in the memory 104. Functional application and data processing, that is, the above method is implemented.
  • Memory 104 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.
  • memory 104 may further include memory remotely located relative to processor 102, which may be connected to mobile terminal 10 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Transmission device 106 is for receiving or transmitting data via a network.
  • the network instance described above may include a wireless network provided by a communication provider of the mobile terminal 10.
  • the transmission device 106 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet.
  • the transmission device 106 can be a Radio Frequency (RF) module for communicating with the Internet wirelessly.
  • NIC Network Interface Controller
  • RF Radio Frequency
  • FIG. 2 is a flowchart of a video processing method according to an embodiment of the present invention. As shown in FIG. 2, the process includes the following steps:
  • Step S202 parsing an image of the frame from the received video data.
  • Step S204 Receive information provided by the VR device, where the information is used to calculate a field of view range using the VR device.
  • Step S206 extracting an image in the field of view from the image according to the information.
  • Step S208 the image in the field of view is sent to the VR device.
  • the VR device provides information for calculating the field of view range, calculates the field of view of the VR device based on the information, parses the image of the frame from the received video data, and extracts the field of view from the image according to the field of view of the VR device.
  • the image only needs to extract the image in the field of view.
  • the data volume of the image in the field of view only accounts for a small part of the data volume of the original image, which greatly reduces the amount of data sent to the VR device, and the data received by the VR device. The amount is also reduced correspondingly, which solves the problem that the amount of data that the VR device needs to transmit when playing video is related to the problem of playing the card, and achieves the technical effect of improving the smoothness of the video played by the VR device.
  • the video processing method provided by the embodiment of the present invention can be applied to a panoramic video, and can also be applied to a non-panoramic video.
  • the above steps are performed by the set top box, wherein the set top box can be a DVB set top box.
  • extracting an image within a field of view from the image according to the information, and transmitting the image in the field of view to the VR device may include: capturing an image within the field of view from the image according to the information; reducing the range of the field of view The resolution of the edge of the image; the image within the field of view with reduced resolution is sent to the VR device.
  • the image in the field of view is intercepted from the original image to obtain a sub-image (ie, the image in the above-mentioned field of view). Since the sub-image only includes the image in the field of view, the sub-image can be visually recognized. It is obtained by cutting the original image.
  • the intercepted video is centered on the axis, up L ⁇ tan ⁇ 1 , downward L ⁇ tan ⁇ 2, the left L ⁇ tan ⁇ 3, right L ⁇ tan ⁇ 4 intercepts.
  • FIG. 3 is a flow chart of a method of processing a panoramic video in accordance with an embodiment of the present invention. As shown in FIG. 3, the method includes:
  • Step S302 Acquire a 360-degree panoramic video transmitted by the broadcast video source.
  • Step S304 intercepting the 360-degree panoramic video to obtain a sub-video of the panoramic video. That is, the set top box intercepts the image in the field of view according to the field of view. For example, when the transmission to the VR device is a set top box viewing distance L, as taken video axial center point, upward L ⁇ tan ⁇ 1, down L ⁇ tan ⁇ 2, the left L ⁇ tan ⁇ 3, right L ⁇ tan ⁇ 4 Intercept.
  • Step S306 the sub video of the panoramic video is subjected to edge blurring processing. That is, the resolution of the central portion image of the sub video of the panoramic video is kept unchanged, and the resolution of the edge portion image of the sub video of the panoramic video is lowered. For example, with the axial center as the center point, the original image quality of the image within 3/4 of the image margin is saved, and the resolution of the remaining range of images is reduced by half.
  • the sub video of the panoramic video is edge-blurred, that is, the video that needs to be transmitted to the VR device is obtained.
  • the video processing method provided by the embodiment of the present invention is applied to the panoramic video in the related art, and the video processing method provided by the embodiment of the present invention is applied to the panoramic video.
  • the amount of data transmitted by the set-top box to the VR device can be effectively reduced, so that the VR device is more smooth when playing the panoramic video.
  • the edges of the image within the field of view are divided according to the range of the sensitive area of the human eye.
  • the angle of view of the human eye is broad, the vision that causes the visual nerves to excite is concentrated in the field of vision.
  • the middle is about 3/4.
  • the central portion of the image within the captured field of view is stored using the original image quality, and the edge portion of the image within the intercepted field of view is stored using a lower resolution, for example, the center of the image within the captured field of view /4 is stored using the original image quality, and the edge 1/4 of the image in the captured field of view is stored at a lower resolution (for example, half of the original resolution).
  • the advantage of reducing the resolution of the edge portion of the image within the intercepted field of view is to effectively utilize the principle that the human eye is insensitive to the edge of the field of view, reducing the amount of data that needs to be transmitted per frame without affecting the user's perception.
  • Picture quality Users using VR devices only need to receive less data and have good viewing effects.
  • the network quality requirements are low, and it is not easy to play the card, which improves the smoothness of playing real-time video and improves the user's viewing experience. .
  • parsing the image of the frame from the received video data may include: acquiring a left-eye video and a right-eye video in the video data, and parsing the corresponding frame from the left-eye video and the right-eye video, respectively.
  • Image a left-eye video and a right-eye video in the video data, and parsing the corresponding frame from the left-eye video and the right-eye video, respectively.
  • Extracting the image in the field of view from the image according to the information may include extracting the image in the field of view from the image corresponding to the left eye video and the image corresponding to the right eye video, respectively.
  • the radio and television encodes the binocular panoramic video in a code stream
  • the set-top box acquires the broadcast code stream through a tuner.
  • the set-top box parses the binocular panoramic video through the different pid (Packet Identifier) of the binocular video, and marks it as a left-eye video or a right-eye video.
  • Each frame of the video includes up and down, left and right omnidirectional video information
  • the set top box intercepts the left eye video and the right eye video according to the position angle information transmitted by the VR device, that is, the image corresponding to the left eye video and the right eye respectively.
  • the image in the field of view is extracted from the image corresponding to the video.
  • transmitting the image in the field of view to the VR device may include: in the case that the VR device has only one screen, the image in the field of view corresponding to the left eye video and the field of view corresponding to the right eye video The images inside are combined left and right; the images in the field of view after the combination are transmitted to the VR device.
  • transmitting the image in the field of view to the VR device may include: in the case where the VR device has two screens, the image in the field of view corresponding to the left eye video and the field of view corresponding to the right eye video The images inside are sent to the VR device.
  • the set-top box After the image inside, if the VR device is a single screen, the set-top box combines the image in the field of view corresponding to the left-eye video and the image in the field of view corresponding to the right-eye video according to the distance between the eyes of the VR device, and combines the video after the left and right combination.
  • the VR device is transmitted to the VR device. If the VR device is dual-screen, the set-top box sends the image in the field of view corresponding to the left-eye video and the image in the field of view corresponding to the right-eye video to the VR device.
  • the VR device receives the video transmitted by the set-top box, and the left and right eyes are ordinary 2D videos, which can be played through simple video playback processing.
  • the VR device only needs to have the capability of an ordinary three-dimensional player, and the requirements for the VR device are low.
  • the system overhead of the VR device is greatly saved.
  • the virtual reality is applied to the live broadcast, giving the user an immersive live broadcast experience.
  • the VR device is prone to problems such as stagnation and resolution degradation, which affects the user's viewing experience, and is in the embodiment of the present invention.
  • the video in the field of view of the VR user is intercepted, and the data volume of the intercepted video is smaller than the data amount of the original video, and the resolution of the edge of the intercepted video is further reduced, thereby further reducing the need for the set top box to be transmitted to the VR device.
  • the amount of data of the video reduces the amount of data received by the VR device by a large part, and ensures the real-time and definition of the live broadcast process even in the case of a relatively harsh network environment, thereby improving the viewing experience of the VR user.
  • the portability and the endurance capability are enhanced in the embodiment of the present invention.
  • the information provided by the VR device may include at least one of: a visual distance of the VR device, an axial angle of the VR device, and a location of the VR device.
  • the VR device obtains the current axial angle through the built-in gyroscope and electronic compass.
  • the viewing angle distance can be obtained according to the position of the optical glasses.
  • FIG. 4 is a flow chart of interaction between a VR device and a set top box according to an embodiment of the present invention. As shown in FIG. 4, the interaction between the VR device and the set top box includes the following steps:
  • step S402 the VR device acquires the current axial angle and the viewing angle.
  • the VR device obtains the current axial angle information based on the built-in gyroscope, electronic compass, and gravity sensing.
  • the viewing angle distance can be obtained according to the position of the optical glasses.
  • Step S404 the VR device transmits the current axial angle and the viewing angle to the set top box in a wireless transmission manner.
  • Step S406 the set top box receives the current axial angle and the viewing angle distance sent by the VR device.
  • Step S408 the set top box intercepts the panoramic video according to the current axial angle and the viewing angle to obtain a panoramic sub video.
  • the set-top box can determine the size of the video that needs to be intercepted according to the viewing angle and the axial angle combined with the angle that can be seen by the binocular field of view.
  • the set-top box intercepts the original video and obtains a panoramic sub-video.
  • Step S410 the set top box transmits the panoramic sub video to the VR device in a wireless transmission manner.
  • step S412 the VR device receives and plays the panoramic sub video. Since the amount of data of the panoramic sub-video is much smaller than the amount of data of the original video, the VR device will be smoother when playing the video.
  • transmitting the image within the field of view to the VR device may include transmitting the image within the field of view to the VR device via WIFI.
  • FIG. 5 is an interaction diagram between a broadcast video source, a digital set top box, and a VR device according to an embodiment of the present invention. As shown in FIG. 5, the interaction between the broadcast video source, the digital set top box, and the VR device includes the following steps:
  • Step S502 Send a panoramic video, that is, the broadcast video source sends the panoramic video to the digital set top box.
  • the panoramic video required by virtual reality comes from the radio and television video source. It needs radio and television to provide dual video streams different from the traditional stream.
  • Each set provides left-eye video and right-eye video, and is distinguished by pid.
  • Each video should be It is a panoramic video format for users to view in panoramic view.
  • After the set-top box receives the panoramic binocular video, it performs video decoding and re-editing.
  • Step S504 transmitting location data, that is, the VR device sends the location data to the digital set top box.
  • Step S506 sending a sub video, that is, the digital set top box sends the sub video to the VR device.
  • the digital set-top box intercepts the video in the field of view of the VR device user according to the location data of the VR device, obtains the sub-video, and sends the sub-video to the VR device by wireless means (for example, WIFI). Since the data volume of the sub video is smaller than the data volume of the original video, the amount of data that the VR device needs to receive is reduced, which solves the technical problem of the video playback jam caused by the excessive amount of data that the VR device needs to receive in the related art.
  • WIFI wireless means
  • the amount of data received by the VR device is reduced by a large portion, the real-time and definition of the live broadcast process can be ensured even in a relatively harsh network environment, thereby improving the viewing experience of the VR user. Meanwhile, in the embodiment of the present invention, the amount of calculation of the VR device is reduced, and the portability and the endurance capability are enhanced.
  • FIG. 6 is a flow chart of still another method of processing a panoramic video in accordance with an embodiment of the present invention. As shown in FIG. 6, the method includes the following steps:
  • Step S602 the set top box receives the single stream dual video of the broadcast transmission. Radio and television encodes the binocular panoramic video in a code stream, and the set-top box acquires the broadcast code stream through the tuner.
  • Step S604 parsing the binocular panoramic video according to the pid, and marking it as a left-eye panoramic video or a right-eye panoramic video. That is, the set top box parses the binocular panoramic video through different pids of the binocular video and marks it as a left eye panoramic video or a right eye panoramic video.
  • step S606 the left-eye panoramic video is intercepted, wherein the range of interception is: 70° on the upper side, 80° on the lower side, 115° on the left side, and 65° on the right side.
  • the panoramic video includes a series of video information of up, down, left, and right, and the set top box intercepts the left eye panoramic video according to the position angle information transmitted by the VR device, and intercepts the video in the field of view of the left eye of the VR device user.
  • step S608 the middle portion of the image is saved at the original resolution, and the edge portion of the image is saved at a lower resolution than the original resolution. Since the human eye is only sensitive to the center of the field of view, the resolution of the edge portion of the image is lowered, and the image quality perceived by the human eye is not affected.
  • step S610 the right-eye panoramic video is intercepted, wherein the range of interception is: 70° on the upper side, 80° on the lower side, 65° on the left side, and 115° on the right side.
  • the set-top box intercepts the right-eye panoramic video according to the position angle information transmitted by the VR device, and intercepts the video in the field of view of the right eye of the VR device user.
  • step S612 the middle portion of the image is saved at the original resolution, and the edge portion of the image is saved at a lower resolution than the original resolution.
  • step S614 it is determined whether the VR device is a single screen. When the determination result is YES, step S616 is performed; when the determination result is no, step S618 is performed.
  • step S616 the video is spliced left and right and transmitted.
  • the set-top box splicing the left and right eye videos, and combining the left and right eyes according to the distance between the eyes of the VR device.
  • step S618 the left and right videos are separately transmitted.
  • the set-top box transmits the dual-screen video separately.
  • step S620 the VR device plays the video.
  • the VR device receives the video transmitted by the set-top box, and the left and right eyes are ordinary 2D videos, which can be played through simple video playback processing.
  • the processed video is sent to the VR device, and the amount of data received by the VR device is small, and the live process can be guaranteed in real time even in a bad network environment. Sex and clarity enhance the viewing experience of VR users. At the same time, since the calculation amount of the VR device is reduced, the portability and the endurance capability are enhanced in the embodiment of the present invention.
  • FIG. 7 is a flowchart of a video playback method according to an embodiment of the present invention. As shown in FIG. 7, the process includes the following steps:
  • Step S702 establishing a connection with the set top box.
  • Step S704 sending information to the set top box, wherein the information is used to calculate a field of view range using the VR device.
  • Step S706 receiving an image in the field of view from the set top box.
  • Step S708 playing an image in the field of view.
  • the VR device sends information for calculating the field of view to the set top box.
  • the set top box calculates the field of view of the VR device according to the information, and the set top box parses the image of the frame from the received video data, and extracts the image from the image according to the field of view of the VR device.
  • the image in the field of view only needs to extract the image in the field of view.
  • the data volume of the image in the field of view only accounts for a small part of the data volume of the original image, which greatly reduces the amount of data sent to the VR device, and the VR device
  • the amount of data received is also reduced correspondingly, which solves the problem that the amount of data that the VR device needs to transmit when playing video is related to the problem of playing the card, and improves the smoothness of the video played by the VR device. Since the amount of data received by the VR device is reduced by a large portion, the real-time and definition of the live broadcast process can be ensured even in a relatively harsh network environment, thereby improving the viewing experience of the VR user. At the same time, since the calculation amount of the VR device is reduced, the portability and the endurance capability are enhanced in the embodiment of the present invention.
  • receiving the image in the field of view from the set top box may include: receiving, from the set top box, an image in a field of view corresponding to the left eye video and an image in a field of view corresponding to the right eye video;
  • the playing the image in the field of view may include: playing the image in the field of view corresponding to the left eye video and the image in the field of view corresponding to the right eye video, and then playing the left eye video; or playing the left eye video in the two screens respectively.
  • the image in the corresponding field of view and the image in the field of view corresponding to the right eye video may include: playing the image in the field of view corresponding to the left eye video and the image in the field of view corresponding to the right eye video, and then playing the left eye video; or playing the left eye video in the two screens respectively.
  • the set top box After the set top box extracts the image in the field of view from the image corresponding to the left eye video and the image corresponding to the right eye video, if the VR device is a single screen, the set top box corresponds the image in the field of view corresponding to the left eye video to the right eye video.
  • the image in the field of view is combined with the left eye distance of the VR device, and the video after the left and right combination is transmitted to the VR device; if the VR device is a dual screen, the set top box respectively corresponds to the image in the field of view corresponding to the left eye video and the right eye video.
  • the image within the field of view is sent to the VR device.
  • the VR device receives the video transmitted by the set-top box, and the left and right eyes are ordinary 2D videos, which can be played through simple video playback processing.
  • the VR device only needs to have the capability of an ordinary three-dimensional player, and the requirements for the VR device are low.
  • the system overhead of the VR device is greatly saved.
  • the information transmitted by the VR device to the set top box may include at least one of: a visual distance of the VR device, an axial angle of the VR device, and a location of the VR device.
  • the VR device obtains the current axial angle through the built-in gyroscope and electronic compass.
  • the viewing angle distance can be obtained according to the position of the optical glasses.
  • receiving an image within a field of view from the set top box may include receiving an image within a field of view from the set top box via WIFI.
  • FIG. 8 is a flow chart of still another method of processing a panoramic video in accordance with an embodiment of the present invention. As shown in FIG. 8, the method includes the following steps:
  • Step S802 the DVB set top box acquires the panoramic video data transmitted by the broadcast video source.
  • Step S804 the DVB set-top box parses the panoramic video to obtain a panoramic image of the current frame.
  • Step S806 the VR device provides the angle coordinate and the line of sight length, and the angle coordinate is transmitted to the DVB set top box through the WIFI network.
  • Step S808 the DVB set top box intercepts the field of view image in the panoramic image according to the angle coordinate provided by the VR device to obtain a sub image of the panoramic image.
  • Step S810 the DVB set-top box performs edge blur processing on the captured view range image to obtain
  • the sub-image of the processed panoramic image that is, the original image quality of the image in the sensitive area of the human eye is saved, and the image of the edge of the visual field is processed and saved at a lower resolution.
  • Step S812 the DVB set top box transmits the sub-image of the processed panoramic image to the VR device through a multi-screen live broadcast technology.
  • step S814 the VR device parses the sub-image of the panoramic image and presents it to the user.
  • Step S816 the VR device acquires the user viewing angle in real time, and transmits the angle coordinate to the set top box in real time, so that the set top box calculates the current visual field range according to the current angle coordinate, and intercepts the panoramic image according to the current visual field range.
  • the set top box transmits the sub-image of the processed panoramic image to the VR device in real time to realize the live broadcast of the panoramic video.
  • the VR device provides information for calculating the field of view range, calculates the field of view of the VR device based on the information, parses the image of the frame from the received video data, and extracts the field of view from the image according to the field of view of the VR device.
  • the image only needs to extract the image in the field of view.
  • the data volume of the image in the field of view only accounts for a small part of the data volume of the original image, which greatly reduces the amount of data sent to the VR device, and the data received by the VR device. The amount is also reduced correspondingly, which solves the problem that the amount of data that needs to be transmitted when the VR device plays video in the related art is too large, and improves the smoothness of the video played by the VR device.
  • the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation.
  • the technical solution of the present application which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM).
  • the method includes a plurality of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method described in the embodiments of the present application.
  • a set-top box is provided in the embodiment, and the set-top box is used to implement the foregoing embodiments and exemplary embodiments, and details are not described herein.
  • the term "module” may implement software, hardware, or a combination of software and hardware for a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 9 is a structural block diagram of a set top box according to an embodiment of the present invention.
  • the set top box includes a receiving module 90, a first wireless communication module 92, a video processing module 94, and a second wireless communication module 96.
  • the receiving module 90 is configured to parse the image of the frame from the received video data.
  • the receiving module 90 may be configured to acquire video data through a broadcast cable network of the broadcast power, and parse the binocular video by parsing different pids in the broadcast code stream.
  • the first wireless communication module 92 is configured to receive information provided by the VR device, wherein the information is used to calculate a field of view using the VR device.
  • the first wireless communication module 92 may be configured to receive parameters such as location, angular coordinates, and line of sight transmitted by the VR device, and based on the information, the set top box calculates a field of view using the VR device.
  • the video processing module 94 is configured to extract an image within the field of view from the image based on the information.
  • the set top box calculates an area of view from the original image using the field of view of the VR device. After the interception is completed, the image obtained by the interception is subjected to edge blurring processing, that is, the resolution of the edge portion of the intercepted image is lowered.
  • the second wireless communication module 96 is configured to transmit an image within a field of view to the VR device.
  • the first wireless communication module 92 and the second wireless communication module 96 can interact with the VR device through the home WIFI network.
  • the set top box and the VR device of the embodiment of the present invention have The two-way interactive function, that is, the second wireless communication module 96 can transmit an image in the field of view to the VR device, and the first wireless communication module 92 can receive parameters such as a position, an angle coordinate, and a line of sight transmitted by the VR device.
  • the video processing module 94 may be configured to intercept images within the field of view from the image based on the information, reducing the resolution of the edges of the image within the field of view; the second wireless communication module 96 may be configured to be reduced Images within the field of view of the resolution are sent to the VR device.
  • the edges of the image within the field of view are divided according to the range of the sensitive area of the human eye.
  • the receiving module 90 may be configured to acquire a left-eye video and a right-eye video in the video data, and parse the image of the corresponding frame from the left-eye video and the right-eye video, respectively;
  • the processing module 94 may be configured to extract images within the field of view from the image corresponding to the left eye video and the image corresponding to the right eye video, respectively.
  • the second wireless communication module 96 may be configured to perform an image within a field of view corresponding to the left eye video and an image within a field of view corresponding to the right eye video. The left and right combination; the image within the field of view after the combination is sent to the VR device.
  • the second wireless communication module 96 may be configured to respectively respectively map the image in the field of view corresponding to the left eye video and the image in the field of view corresponding to the right eye video Send to the VR device.
  • the information provided by the VR device may include at least one of: a visual distance of the VR device, an axial angle of the VR device, and a location of the VR device.
  • the second wireless communication module 96 may be configured to transmit images within the field of view to the VR device via WIFI.
  • FIG. 10 is a structural block diagram of a VR device according to an embodiment of the present invention. As shown in FIG. 10, the VR device includes a third wireless communication module 80, a fourth wireless communication module 82, a fifth wireless communication module 84, and a video playback module 86. .
  • the third wireless communication module 80 is configured to establish a connection with the set top box.
  • the fourth wireless communication module 82 is configured to transmit information to the set top box, wherein the information is used to calculate a field of view range using the VR device.
  • the fifth wireless communication module 84 is configured to receive images within the field of view from the set top box.
  • the video playback module 86 is configured to play an image within the field of view.
  • the fifth wireless communication module 84 may be configured to receive, from the set top box, an image within a field of view corresponding to the left eye video and an image within a field of view corresponding to the right eye video; the video playback module 86 may be configured to be left The image in the field of view corresponding to the eye video and the image in the field of view corresponding to the right eye video are combined to perform left and right combination; or, in the two screens, the image in the field of view corresponding to the left eye video and the right eye video are respectively played. The image within the corresponding field of view.
  • the VR device may further include a location acquisition module.
  • Position acquisition mode The block is configured to obtain the visual distance of the VR device, the axial angle of the VR device, and the position of the VR device.
  • the position acquisition module may include a gyroscope, an electronic compass, and a gravity sensing device to obtain a user's axial angle through the gyroscope and the electronic compass.
  • the fifth wireless communication module 84 may be configured to receive images within the field of view from the set top box via WIFI.
  • the video playing module 86 can be the same as the ordinary three-dimensional player, and only needs to play the video transmitted by the set-top box, which greatly saves the VR system overhead.
  • each of the foregoing modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, implementing the foregoing modules by the same processor; or being implemented by different processors. The above modules.
  • Embodiments of the present invention provide a machine readable medium.
  • the above machine readable medium may be arranged to store program code for performing the following steps:
  • the above machine readable medium may include, but is not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, a magnetic disk, or A variety of media such as optical discs that can store program code.
  • the processor may perform according to the stored program code in the machine readable medium: intercepting the image in the field of view from the image according to the information; reducing the resolution of the edge of the image in the field of view; reducing the resolution Images within the range of view are sent to the VR device.
  • the processor may execute according to the stored program code in the machine readable medium: the edges of the image within the field of view are divided according to the range of the sensitive area of the human eye.
  • the processor can execute according to stored program code in the machine readable medium: Obtaining a left-eye video and a right-eye video in the video data, and respectively parsing the image of the corresponding frame from the left-eye video and the right-eye video; respectively extracting the visual field range from the image corresponding to the left-eye video and the image corresponding to the right-eye video The image inside.
  • the processor may execute according to the stored program code in the machine readable medium: in the case that the VR device has only one screen, the image in the field of view corresponding to the left eye video corresponds to the right eye video. The images in the field of view are combined left and right; the images in the field of view after the combination are transmitted to the VR device.
  • the processor may execute according to the stored program code in the machine readable medium: in the case that the VR device has two screens, the image in the field of view corresponding to the left eye video corresponds to the right eye video. Images within the field of view are sent to the VR device separately.
  • the processor may execute according to the stored program code in the machine readable medium: transmitting the image in the field of view to the VR device through the WIFI.
  • the processor may execute according to the stored program code in the machine readable medium: receiving, from the set top box, an image in a field of view corresponding to the left eye video and an image in a field of view corresponding to the right eye video; The image in the field of view corresponding to the video and the image in the field of view corresponding to the right eye video are combined to perform left-right combination; or, in the two screens, the image in the field of view corresponding to the left-eye video and the right-eye video are respectively played. The image within the field of view.
  • the processor may execute according to the stored program code in the machine readable medium: receiving images within the field of view from the set top box via WIFI.
  • Such software may be distributed on a machine-readable medium, such as a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
  • a computer-readable medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .
  • the embodiment of the present invention provides a video processing method, a video playing method, a set-top box, and a VR device, which solves the problem that the amount of data that needs to be transmitted when the VR device plays a video in the related art is too large, and the VR device is improved.
  • the technical effect of playing the smoothness of the video is improved.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本文公开了一种视频处理方法、视频播放方法、机顶盒以及VR设备。该视频处理方法包括：从接收到的视频数据中解析出帧的图像；接收VR设备提供的信息，其中，信息用于计算使用VR设备的视野范围；根据该信息从图像中提取视野范围内的图像；将视野范围内的图像发送给VR设备。通过上述方案，解决了相关技术中VR设备播放视频时需要传输的数据量太大造成的播放卡顿的问题，进而达到了提高VR设备播放视频的流畅性的技术效果。

Description

视频处理方法、视频播放方法、机顶盒以及VR设备 技术领域
本申请涉及但不限于视频领域，尤其涉及一种视频处理方法、视频播放方法、机顶盒以及VR设备。
背景技术
随着VR(虚拟现实，英文全称：Virtual Reality)市场的不断升温，虚拟现实逐渐走向大众视野，传统的视频媒体受到冲击，越来越多VR设备被开发出来。然而，目前虚拟现实播放技术只能局限于视频点播，且对解码能力与续航能力有较为苛刻的要求。目前数字电视系统仍然是电视节目提供业务的主要角色，电视直播、电视剧首播等仍然是优先在数字电视网络进行的。DVB(数字视频广播，英文全称：Digital Video Broadcasting)机顶盒直播业务势必会从2D直播向3D直播直至虚拟现实直播转变。
通常，全景视频的播放需要进行大量的数据传输，VR设备需要将全景视频下载至本地。大量的数据传输需要较好的网络环境与较大的带宽，网络恶劣的条件下会出现播放卡顿、分辨率降低等现象，影响用户体验。
发明概述
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本发明实施例提供了一种视频处理方法、视频播放方法、机顶盒以及VR设备，以至少解决相关技术中VR设备播放视频时需要传输的数据量太大造成的播放卡顿的问题。
根据本申请的一个方面，提供了一种视频处理方法，包括：从接收到的视频数据中解析出帧的图像；接收VR设备提供的信息，其中，所述信息用于计算使用所述VR设备的视野范围；根据所述信息从所述图像中提取所述视野范围内的图像；将所述视野范围内的图像发送给所述VR设备。
在示例性实施方式中，根据所述信息从所述图像中提取所述视野范围内的图像，并将所述视野范围内的图像发送给所述VR设备可以包括：根据所述信息从所述图像中截取所述视野范围内的图像；降低所述视野范围内的图像的边缘的分辨率；将降低了分辨率的所述视野范围内的图像发送给所述VR设备。
在示例性实施方式中，述根据所述信息从所述图像中截取所述视野范围内的图像，可以包括：根据人眼敏感区的范围划分出所述视野范围内的图像的边缘。
在示例性实施方式中，从接收到的视频数据中解析出帧的图像可以包括：获取所述视频数据中的左眼视频和右眼视频，并从所述左眼视频和所述右眼视频中分别解析出对应所述帧的图像；
根据所述信息从所述图像中提取所述视野范围内的图像可以包括：分别从所述左眼视频对应的图像和所述右眼视频对应的图像中提取所述视野范围内的图像。
在示例性实施方式中，将所述视野范围内的图像发送给所述VR设备可以包括：在所述VR设备仅有一个屏幕的情况下，将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像进行左右结合；将结合之后的所述视野范围内的图像发送给所述VR设备。
在示例性实施方式中，将所述视野范围内的图像发送给所述VR设备可以包括：在所述VR设备有两个屏幕的情况下，将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像分别发送给所述VR设备。
在示例性实施方式中，所述VR设备提供的信息可以包括以下至少之一：所述VR设备的视觉距离、所述VR设备的轴向角度、所述VR设备的位置。
在示例性实施方式中，将所述视野范围内的图像发送给所述VR设备可以包括：通过无线保真(WIFI)将所述视野范围内的图像发送给所述VR设备。
根据本申请的另一个方面，提供了一种视频播放方法，包括：与机顶盒 建立连接；向所述机顶盒发送信息，其中，所述信息用于计算使用VR设备的视野范围；从所述机顶盒接收所述视野范围内的图像；播放所述视野范围内的图像。
在示例性实施方式中，从所述机顶盒接收所述视野范围内的图像可以包括：从所述机顶盒接收左眼视频对应的所述视野范围内的图像和右眼视频对应的所述视野范围内的图像；
播放所述视野范围内的图像可以包括：将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像进行左右结合之后进行播放；或者，在两个屏幕中分别播放所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像。
在示例性实施方式中，所述向所述机顶盒发送的信息可以包括以下至少之一：所述VR设备的视觉距离、所述VR设备的轴向角度、所述VR设备的位置。
在示例性实施方式中，从所述机顶盒接收所述视野范围内的图像可以包括：通过WIFI从所述机顶盒接收所述视野范围内的图像。
根据本申请的另一个方面，提供了一种机顶盒，包括：接收模块，配置为从接收到的视频数据中解析出帧的图像；第一无线通信模块，配置为接收VR设备提供的信息，其中，所述信息用于计算使用所述VR设备的视野范围；视频处理模块，配置为根据所述信息从所述图像中提取所述视野范围内的图像；第二无线通信模块，配置为将所述视野范围内的图像发送给所述VR设备。
在示例性实施方式中，所述视频处理模块可以配置为根据所述信息从所述图像中截取所述视野范围内的图像，降低所述视野范围内的图像的边缘的分辨率；所述第二无线通信模块可以配置为将降低了分辨率的所述视野范围内的图像发送给所述VR设备。
在示例性实施方式中，所述视频处理模块配置为根据人眼敏感区的范围划分出所述视野范围内的图像的边缘。
在示例性实施方式中，所述接收模块可以配置为获取所述视频数据中的 左眼视频和右眼视频，并从所述左眼视频和所述右眼视频中分别解析出对应所述帧的图像；所述视频处理模块可以配置为分别从所述左眼视频对应的图像和所述右眼视频对应的图像中提取所述视野范围内的图像。
在示例性实施方式中，在所述VR设备仅有一个屏幕的情况下，所述第二无线通信模块可以配置为将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像进行左右结合；将结合之后的所述视野范围内的图像发送给所述VR设备。
在示例性实施方式中，在所述VR设备有两个屏幕的情况下，所述第二无线通信模块可以配置为将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像分别发送给所述VR设备。
在示例性实施方式中，所述VR设备提供的信息可以包括以下至少之一：所述VR设备的视觉距离、所述VR设备的轴向角度、所述VR设备的位置。
在示例性实施方式中，所述第二无线通信模块可以配置为通过WIFI将所述视野范围内的图像发送给所述VR设备。
根据本申请的另一个方面，提供了一种VR设备，包括：第三无线通信模块，配置为与机顶盒建立连接；第四无线通信模块，配置为向所述机顶盒发送信息，其中，所述信息用于计算使用VR设备的视野范围；第五无线通信模块，配置为从所述机顶盒接收所述视野范围内的图像；视频播放模块，配置为播放所述视野范围内的图像。
在示例性实施方式中，所述第五无线通信模块可以配置为从所述机顶盒接收左眼视频对应的所述视野范围内的图像和右眼视频对应的所述视野范围内的图像；所述视频播放模块可以配置为将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像进行左右结合之后进行播放；或者，在两个屏幕中分别播放所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像。
在示例性实施方式中，所述VR设备还可以包括：位置获取模块，配置为获取所述VR设备的视觉距离、所述VR设备的轴向角度、所述VR设备的位置。
在示例性实施方式中，所述第五无线通信模块可以配置为通过WIFI从所述机顶盒接收所述视野范围内的图像。
本申请实施例还提供一种机器可读介质，存储有计算机可执行程序，所述计算机可执行程序被处理器执行时实现上述的视频处理方法。
本申请实施例还提供一种机器可读介质，存储有计算机可执行程序，所述计算机可执行程序被处理器执行时实现上述的视频播放方法。
通过本申请，由于VR设备提供用于计算视野范围的信息，根据信息计算出使用VR设备的视野范围，从接收到的视频数据中解析出帧的图像，根据使用VR设备的视野范围从图像中提取视野范围内的图像，视野范围内的图像的数据量只占原始图像的数据量的很小一部分，这就大大减少了发送给VR设备的数据量，VR设备接收的数据量也相应减少，解决了相关技术中VR设备播放视频时需要传输的数据量太大造成的播放卡顿的问题，达到了提高VR设备播放视频的流畅性的技术效果。
在阅读并理解了附图和详细描述后，可以明白其他方面。
附图概述
此处所说明的附图用来提供对本申请的进一步理解，构成本申请的一部分，本申请的示意性实施例及其说明用于解释本申请，并不构成对本申请的不当限定。在附图中：
图1是本发明实施例的执行视频处理方法的移动终端的硬件结构框图；
图2是根据本发明实施例的视频处理方法的流程图；
图3是根据本发明实施例的一种对全景视频进行处理的方法的流程图；
图4是根据本发明实施例的VR设备与机顶盒的交互流程图；
图5是根据本发明实施例的广电视频源、数字机顶盒、VR设备之间的交互图；
图6是根据本发明实施例的又一种对全景视频进行处理的方法的流程图；
图7是根据本发明实施例的视频播放方法的流程图；
图8是根据本发明实施例的又一种对全景视频进行处理的方法的流程图；
图9是根据本发明实施例的机顶盒的结构框图；
图10是根据本发明实施例的VR设备的结构框图。
详述
下文中将参考附图并结合实施例来详细说明本申请。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。
需要说明的是，本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。
实施例一
本申请实施例一所提供的方法实施例可以在移动终端、计算机终端或者类似的运算装置中执行。以运行在移动终端上为例，图1是本发明实施例的执行视频处理方法的移动终端的硬件结构框图。如图1所示，移动终端10可以包括一个或多个(图中仅示出一个)处理器102(处理器102可以包括但不限于微处理器(MCU)或可编程逻辑器件(FPGA)等的处理装置)、用于存储数据的存储器104、以及用于通信功能的传输装置106。本领域普通技术人员可以理解，图1所示的结构仅为示意，其并不对上述电子装置的结构造成限定。例如，移动终端10还可包括比图1中所示更多或者更少的组件，或者具有与图1所示不同的配置。
存储器104可用于存储应用软件的软件程序以及模块，如本发明实施例中的视频处理方法对应的程序指令或模块，处理器102通过运行存储在存储器104内的软件程序以及模块，从而执行各种功能应用以及数据处理，即实现上述的方法。存储器104可包括高速随机存储器，还可包括非易失性存储器，如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中，存储器104可进一步包括相对于处理器102远程设置的存储器，这些远程存储器可以通过网络连接至移动终端10。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
传输装置106用于经由一个网络接收或者发送数据。上述的网络实例可包括移动终端10的通信供应商提供的无线网络。在一个实例中，传输装置106包括一个网络适配器(Network Interface Controller，NIC)，其可通过基站与其他网络设备相连从而可与互联网进行通信。在一个实例中，传输装置106可以为射频(Radio Frequency，RF)模块，其用于通过无线方式与互联网进行通信。
在本实施例中提供了一种运行于上述移动终端的视频处理方法，图2是根据本发明实施例的视频处理方法的流程图，如图2所示，该流程包括如下步骤：
步骤S202，从接收到的视频数据中解析出帧的图像。
步骤S204，接收VR设备提供的信息，其中，信息用于计算使用VR设备的视野范围。
步骤S206，根据信息从图像中提取视野范围内的图像。
步骤S208，将视野范围内的图像发送给VR设备。
VR设备提供用于计算视野范围的信息，根据这些信息计算出使用VR设备的视野范围，从接收到的视频数据中解析出帧的图像，根据使用VR设备的视野范围从图像中提取视野范围内的图像，只需要提取视野范围内的图像，视野范围内的图像的数据量只占原始图像的数据量的很小一部分，这就大大减少了发送给VR设备的数据量，VR设备接收的数据量也相应减少，解决了相关技术中VR设备播放视频时需要传输的数据量太大造成的播放卡顿的问题，达到了提高VR设备播放视频的流畅性的技术效果。
本发明实施例所提供的视频处理方法可以应用于全景视频中，也可以应用于非全景视频中。
以上步骤由机顶盒来执行，其中，机顶盒可以是DVB机顶盒。
在示例性实施方式中，根据信息从图像中提取视野范围内的图像，并将视野范围内的图像发送给VR设备可以包括：根据信息从图像中截取视野范围内的图像；降低视野范围内的图像的边缘的分辨率；将降低了分辨率的视野范围内的图像发送给VR设备。
根据使用VR设备的视野范围，从原始图像中截取视野范围内的图像，得到子图像(即上述视野范围内的图像)，由于子图像只包含视野范围内的图像，因此可以形象地认为子图像是将原始图像进行切割得到的。在对原始图像进行截取的过程中，按照视距与人眼角度的换算关系，如果接收到VR设备传输的视距为L，截取视频以轴向为中心点，向上L×tanα1，向下L×tanα2，向左L×tanα3，向右L×tanα4进行截取。作为一种示例性的实施例，在对右眼视图截取时，α1＝70°，α2＝80°，α3＝65°，α4＝115°，在对左眼视图截取时，α1＝70°，α2＝80°，α3＝115°，α4＝65°。
图3是根据本发明实施例的一种对全景视频进行处理的方法的流程图。如图3所示，该方法包括：
步骤S302，获取广电视频源传输的360度全景视频。
步骤S304，将360度全景视频进行截取，得到全景视频的子视频。即，机顶盒根据视野范围截取视野范围内的图像。例如，当VR设备传输给机顶盒的视距为L时，截取视频以轴向为中心点，向上L×tanα1，向下L×tanα2，向左L×tanα3，向右L×tanα4进行截取。作为一种示例性的实施例，在对右眼视图截取时，α1＝70°，α2＝80°，α3＝65°，α4＝115°，在对左眼视图截取时，α1＝70°，α2＝80°，α3＝115°，α4＝65°。
步骤S306，将全景视频的子视频进行边缘模糊处理。即，将全景视频的子视频的中心部分图像的分辨率保持不变，将全景视频的子视频的边缘部分图像的分辨率降低。例如，以轴向为中心点，取与图像边距3/4内图像原画质保存，其余范围的图像的分辨率降低一半保存。将全景视频的子视频进行边缘模糊处理，即得到需要传输给VR设备的视频。
由于全景视频的数据量很大，在相关技术中VR设备播放全景视频很容易出现卡顿，将本发明实施例所提供的视频处理方法应用于全景视频中，在不影响VR设备的用户观看到的画质质量的前提下，能够有效减少机顶盒向VR设备传输的数据量，使得VR设备播放全景视频时更加流畅。
在示例性实施方式中，根据人眼敏感区的范围划分出视野范围内的图像的边缘。
人眼的视野角度虽然宽阔，但是引起视觉神经兴奋的视觉集中在视野的 中间约3/4范围内。将截取的视野范围内的图像的中心部分使用原画质进行存储，将截取的视野范围内的图像的边缘部分使用较低的分辨率存储，例如，将截取的视野范围内的图像的中心3/4使用原画质进行存储，将截取的视野范围内的图像的边缘1/4使用较低的分辨率(例如，原分辨率的一半)进行存储。
降低截取的视野范围内的图像的边缘部分的分辨率的好处是：有效利用了人眼对视野边缘不敏感的原理，在降低了每一帧需要传输的数据量的同时不影响用户感受到的画面质量。用户使用VR设备只需要接收较少的数据量也能有好的观看效果，对网络质量要求低，不容易出现播放卡顿的情况，提高了播放实时视频的流畅性，提升了用户的观看体验。
在示例性实施方式中，从接收到的视频数据中解析出帧的图像可以包括：获取视频数据中的左眼视频和右眼视频，并从左眼视频和右眼视频中分别解析出对应帧的图像；
根据信息从图像中提取视野范围内的图像可以包括：分别从左眼视频对应的图像和右眼视频对应的图像中提取视野范围内的图像。
广电将双眼全景视频编码在一个码流中，机顶盒通过调谐器(tuner)获取广电码流。机顶盒通过双眼视频不同的pid(Packet Identifier，包标识符)解析出双目全景视频，并标记为左眼视频或右眼视频。视频的每一帧中包括上下左右前后全方位的视频信息，机顶盒根据VR设备传输过来的位置角度信息将左眼视频和右眼视频进行截取，即，分别从左眼视频对应的图像和右眼视频对应的图像中提取视野范围内的图像。
在示例性实施方式中，将视野范围内的图像发送给VR设备可以包括：在VR设备仅有一个屏幕的情况下，将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像进行左右结合；将结合之后的视野范围内的图像发送给VR设备。
在示例性实施方式中，将视野范围内的图像发送给VR设备可以包括：在VR设备有两个屏幕的情况下，将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像分别发送给VR设备。
在机顶盒从左眼视频对应的图像和右眼视频对应的图像中提取视野范围 内的图像之后，如果VR设备为单屏幕，机顶盒将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像按照VR设备双眼距离进行左右结合，将左右结合之后的视频传输给VR设备；如果VR设备为双屏幕，机顶盒分别将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像发送给VR设备。
VR设备接收到机顶盒传输的视频，左右眼分别为普通的2D视频，通过简单的视频播放处理即可进行播放，VR设备只需要具有普通三维播放器的能力即可，对VR设备的要求低，大大节省了VR设备的系统开销。
相对于传统机顶盒直播，将虚拟现实应用于直播中，给用户带来身临其境的直播体验。由于广电同轴线网络与家庭WIFI网络传输速率不同，相关技术中将虚拟现实应用于直播中时，VR设备容易出现卡顿、分辨率降低等问题，影响用户观看体验，而在本发明实施例中，截取VR使用者视野范围内的视频，截取后的视频的数据量小于原始视频的数据量，再将截取后的视频的边缘的分辨率降低，这样进一步减少了机顶盒需要传输给VR设备的视频的数据量，使得VR设备接收的数据量减少了很大一部分，即使在网络环境较为恶劣的情况下也能保证直播过程的实时性和清晰度，提升了VR使用者的观看体验。同时，由于本发明实施例中，VR设备的运算量减少，便携性和续航能力增强。
在示例性实施方式中，VR设备提供的信息可以包括以下至少之一：VR设备的视觉距离、VR设备的轴向角度、VR设备的位置。
VR设备通过内置的陀螺仪、电子罗盘获取目前轴向角度。根据光学眼镜的位置可以获取视角距离。
图4是根据本发明实施例的VR设备与机顶盒的交互流程图。如图4所示，VR设备与机顶盒之间的交互包括以下步骤：
步骤S402，VR设备获取目前轴向角度和视角距离。VR设备根据内置的陀螺仪、电子罗盘、重力感应获取目前的轴向角度信息。根据光学眼镜的位置可以获取视角距离。
步骤S404，VR设备以无线传输方式将目前轴向角度和视角距离发送给机顶盒。
步骤S406，机顶盒接收VR设备发送的目前轴向角度和视角距离。
步骤S408，机顶盒根据目前轴向角度和视角距离将全景视频进行截取，得到全景子视频。机顶盒根据视角距离和轴向角度，结合双目视野可以看到的角度，可以确定需要截取的视频大小。机顶盒将原始视频进行截取后，得到全景子视频。
步骤S410，机顶盒以无线传输方式将全景子视频传输给VR设备。
步骤S412，VR设备接收并播放全景子视频。由于全景子视频的数据量远远小于原始视频的数据量，VR设备在播放视频的时候会更流畅。
在示例性实施方式中，将视野范围内的图像发送给VR设备可以包括：通过WIFI将视野范围内的图像发送给VR设备。
图5是根据本发明实施例的广电视频源、数字机顶盒、VR设备之间的交互图。如图5所示，广电视频源、数字机顶盒、VR设备之间的交互包括以下步骤：
步骤S502，发送全景视频，即，广电视频源向数字机顶盒发送全景视频。虚拟现实所需要的全景视频来源于广电视频源，需要广电提供不同于传统码流的双视频码流，每一套节目提供左眼视频与右眼视频，并通过pid进行区分，每套视频应为全景视频格式，供用户进行全景观看。机顶盒接收到全景双目视频后，进行视频解码与重新编辑。
步骤S504，发送位置数据，即，VR设备向数字机顶盒发送位置数据。
步骤S506，发送子视频，即，数字机顶盒向VR设备发送子视频。数字机顶盒根据VR设备的位置数据截取VR设备使用者的视野范围内的视频，得到子视频，并通过无线方式(例如WIFI)将子视频发送给VR设备。由于子视频的数据量小于原始视频的数据量，VR设备需要接收的数据量减小，解决了相关技术中由于VR设备需要接收的数据量太大造成的视频播放卡顿的技术问题。由于VR设备接收的数据量减少了很大一部分，即使在网络环境较为恶劣的情况下也能保证直播过程的实时性和清晰度，提升了VR使用者的观看体验。同时，在本发明实施例中，VR设备的运算量减少，便携性和续航能力增强。
图6是根据本发明实施例的又一种对全景视频进行处理的方法的流程图。如图6所示，该方法包括以下步骤：
步骤S602，机顶盒接收广电传输的单码流双视频。广电将双眼全景视频编码在一个码流中，机顶盒通过tuner获取广电码流。
步骤S604，根据pid解析出双目全景视频，并标记为左眼全景视频或者右眼全景视频。即，机顶盒通过双眼视频不同的pid解析出双目全景视频，并标记为左眼全景视频或右眼全景视频。
步骤S606，对左眼全景视频进行截取，其中截取的范围是：上边可见70°，下边可见80°，左边可见115°，右边可见65°。全景视频一帧中包括上下左右前后全方位的视频信息，机顶盒根据VR设备传输过来的位置角度信息将左眼全景视频进行截取，截取出VR设备使用者左眼的视野范围内的视频。
步骤S608，对图像的中间部分以原分辨率保存，对图像的边缘部分以低于原分辨率的分辨率保存。由于人眼只对视野中心部分敏感，因此，将图像的边缘部分的分辨率降低，不会影响人眼所感受到的图像质量。
步骤S610，对右眼全景视频进行截取，其中截取的范围是：上边可见70°，下边可见80°，左边可见65°，右边可见115°。机顶盒根据VR设备传输过来的位置角度信息将右眼全景视频进行截取，截取出VR设备使用者右眼的视野范围内的视频。
步骤S612，对图像的中间部分以原分辨率保存，对图像的边缘部分以低于原分辨率的分辨率保存。
步骤S614，判断VR设备是否为单屏幕。当判断结果为是时，执行步骤S616；当判断结果为否时，执行步骤S618。
步骤S616，左右拼接视频并传输。
如果VR设备为单屏幕，机顶盒将左右眼视频拼接，按照VR设备双眼距离进行左右结合。
步骤S618，左右视频分别传输。
如果VR设备为双屏幕，机顶盒将双屏幕视频分别传输。
步骤S620，VR设备播放视频。
VR设备接收到机顶盒传输的视频，左右眼分别为普通的2D视频，通过简单的视频播放处理即可进行播放。
在本发明实施例中，机顶盒对原始视频进行处理后，将处理后的视频发送给VR设备，VR设备接收的数据量较小，即使在网络环境较为恶劣的情况下也能保证直播过程的实时性和清晰度，提升了VR使用者的观看体验。同时，由于本发明实施例中，VR设备的运算量减少，便携性和续航能力增强。
在本实施例中提供了一种运行于VR设备的视频播放方法，图7是根据本发明实施例的视频播放方法的流程图，如图7所示，该流程包括如下步骤：
步骤S702，与机顶盒建立连接。
步骤S704，向机顶盒发送信息，其中，信息用于计算使用VR设备的视野范围。
步骤S706，从机顶盒接收视野范围内的图像。
步骤S708，播放视野范围内的图像。
VR设备向机顶盒发送用于计算视野范围的信息，机顶盒根据这些信息计算使用VR设备的视野范围，机顶盒从接收到的视频数据中解析出帧的图像，根据使用VR设备的视野范围从图像中提取视野范围内的图像，只需要提取视野范围内的图像，视野范围内的图像的数据量只占原始图像的数据量的很小一部分，这就大大减少了发送给VR设备的数据量，VR设备接收的数据量也相应减少，解决了相关技术中VR设备播放视频时需要传输的数据量太大造成的播放卡顿的问题，提升了VR设备播放视频的流畅性。由于VR设备接收的数据量减少了很大一部分，即使在网络环境较为恶劣的情况下也能保证直播过程的实时性和清晰度，提升了VR使用者的观看体验。同时，由于本发明实施例中，VR设备的运算量减少，便携性和续航能力增强。
在示例性实施方式中，从机顶盒接收视野范围内的图像可以包括：从机顶盒接收左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像；
播放视野范围内的图像可以包括：将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像进行左右结合之后进行播放；或者，在两个屏幕中分别播放左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像。
在机顶盒从左眼视频对应的图像和右眼视频对应的图像中提取视野范围内的图像之后，如果VR设备为单屏幕，机顶盒将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像按照VR设备双眼距离进行左右结合，将左右结合之后的视频传输给VR设备；如果VR设备为双屏幕，机顶盒分别将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像发送给VR设备。
VR设备接收到机顶盒传输的视频，左右眼分别为普通的2D视频，通过简单的视频播放处理即可进行播放，VR设备只需要具有普通三维播放器的能力即可，对VR设备的要求低，大大节省了VR设备的系统开销。
在示例性实施方式中，VR设备向机顶盒发送的信息可以包括以下至少之一：VR设备的视觉距离、VR设备的轴向角度、VR设备的位置。
VR设备通过内置的陀螺仪、电子罗盘获取目前轴向角度。根据光学眼镜的位置可以获取视角距离。
在示例性实施方式中，从机顶盒接收视野范围内的图像可以包括：通过WIFI从机顶盒接收视野范围内的图像。
图8是根据本发明实施例的又一种对全景视频进行处理的方法的流程图。如图8所示，该方法包括以下步骤：
步骤S802，DVB机顶盒获取广电视频源传输的全景视频数据。
步骤S804，DVB机顶盒解析全景视频，获取当前帧的全景图像。
步骤S806，VR设备提供角度坐标与视距长度，将该角度坐标通过WIFI网络传输给DVB机顶盒。
步骤S808，DVB机顶盒根据VR设备提供的角度坐标，截取全景图像中的视野范围图像，得到全景图像的子图像。
步骤S810，DVB机顶盒将截取的视野范围图像做边缘模糊处理，得到 处理过的全景图像的子图像，即，将人眼敏感区内图像原画质保存，将视野边缘图像以较低的分辨率处理保存。
步骤S812，DVB机顶盒通过多屏直播技术，将处理过的全景图像的子图像传输给VR设备。
步骤S814，VR设备解析全景图像的子图像，并向用户展示。
步骤S816，VR设备实时获取用户观看角度，将角度坐标实时传输给机顶盒，以使机顶盒根据当前的角度坐标计算当前视野范围，并根据当前视野范围截取全景图像。机顶盒实时向VR设备传输处理过的全景图像的子图像，实现全景视频的直播。
VR设备提供用于计算视野范围的信息，根据这些信息计算出使用VR设备的视野范围，从接收到的视频数据中解析出帧的图像，根据使用VR设备的视野范围从图像中提取视野范围内的图像，只需要提取视野范围内的图像，视野范围内的图像的数据量只占原始图像的数据量的很小一部分，这就大大减少了发送给VR设备的数据量，VR设备接收的数据量也相应减少，解决了相关技术中VR设备播放视频时需要传输的数据量太大造成的播放卡顿的问题，提升了VR设备播放视频的流畅性。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，或者网络设备等)执行本申请实施例所述的方法。
实施例二
在本实施例中提供了一种机顶盒，该机顶盒用于实现上述实施例及示例性实施方式，已经进行过说明的不再赘述。如以下所使用的，术语“模块”可以实现预定功能的软件、硬件、或软件和硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现，但是硬件，或者软件和硬件的组合的实现也是可能并被构想的。
图9是根据本发明实施例的机顶盒的结构框图，如图9所示，该机顶盒包括接收模块90、第一无线通信模块92、视频处理模块94、第二无线通信模块96。
接收模块90，配置为从接收到的视频数据中解析出帧的图像。
在示例性实施方式中，接收模块90，可以配置为通过广电的同轴电缆网络获取视频数据，通过解析广电码流中不同的pid解析出双目视频。
第一无线通信模块92，配置为接收VR设备提供的信息，其中，信息用于计算使用VR设备的视野范围。
在示例性实施方式中，第一无线通信模块92，可以配置为接收VR设备发送的位置、角度坐标、视距等参数，根据这些信息，机顶盒计算使用VR设备的视野范围。
视频处理模块94，配置为根据信息从图像中提取视野范围内的图像。
在示例性实施方式中，机顶盒计算使用VR设备的视野范围，从原始图像中截取视野范围内的图像。截取完成后，对截取得到的图像做边缘模糊处理，即，将截取到的图像的边缘部分的分辨率降低。
第二无线通信模块96，配置为将视野范围内的图像发送给VR设备。
在示例性实施方式中，第一无线通信模块92和第二无线通信模块96可以通过家用WIFI网络与VR设备进行交互，与传统机顶盒的多屏直播不同，本发明实施例的机顶盒与VR设备具有双向交互功能，即，第二无线通信模块96可以将视野范围内的图像发送给VR设备，第一无线通信模块92可以接收VR设备发送的位置、角度坐标、视距等参数。
在示例性实施方式中，视频处理模块94可以配置为根据信息从图像中截取视野范围内的图像，降低视野范围内的图像的边缘的分辨率；第二无线通信模块96可以配置为将降低了分辨率的视野范围内的图像发送给VR设备。
在示例性实施方式中，根据人眼敏感区的范围划分出视野范围内的图像的边缘。
在示例性实施方式中，接收模块90可以配置为获取视频数据中的左眼视频和右眼视频，并从左眼视频和右眼视频中分别解析出对应帧的图像；视频 处理模块94可以配置为分别从左眼视频对应的图像和右眼视频对应的图像中提取视野范围内的图像。
在示例性实施方式中，在VR设备仅有一个屏幕的情况下，第二无线通信模块96可以配置为将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像进行左右结合；将结合之后的视野范围内的图像发送给VR设备。
在示例性实施方式中，在VR设备有两个屏幕的情况下，第二无线通信模块96可以配置为将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像分别发送给VR设备。
在示例性实施方式中，VR设备提供的信息可以包括以下至少之一：VR设备的视觉距离、VR设备的轴向角度、VR设备的位置。
在示例性实施方式中，第二无线通信模块96可以配置为通过WIFI将视野范围内的图像发送给VR设备。
本发明实施例还提供了一种VR设备。图10是根据本发明实施例的VR设备的结构框图，如图10所示，该VR设备包括第三无线通信模块80、第四无线通信模块82、第五无线通信模块84、视频播放模块86。
第三无线通信模块80配置为与机顶盒建立连接。
第四无线通信模块82配置为向机顶盒发送信息，其中，信息用于计算使用VR设备的视野范围。
第五无线通信模块84配置为从机顶盒接收视野范围内的图像。
视频播放模块86配置为播放视野范围内的图像。
在示例性实施方式中，第五无线通信模块84可以配置为从机顶盒接收左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像；视频播放模块86可以配置为将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像进行左右结合之后进行播放；或者，在两个屏幕中分别播放左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像。
在示例性实施方式中，VR设备还可以包括位置获取模块。位置获取模 块配置为获取VR设备的视觉距离、VR设备的轴向角度、VR设备的位置。
位置获取模块可以包括陀螺仪、电子罗盘、重力感应器件，通过陀螺仪、电子罗盘获取用户的轴向角度。
在示例性实施方式中，第五无线通信模块84可以配置为通过WIFI从机顶盒接收视野范围内的图像。
视频播放模块86可以与普通三维播放器相同，只需播放机顶盒传输的视频，大大节省了VR系统开销。
需要说明的是，上述每个模块是可以通过软件或硬件来实现的，对于后者，可以通过以下方式实现，但不限于此：由同一处理器实现上述模块；或者，由不同的处理器实现上述模块。
实施例三
本发明实施例提供了一种机器可读介质。在本实施例中，上述机器可读介质可以被设置为存储用于执行以下步骤的程序代码：
S11，从接收到的视频数据中解析出帧的图像。
S12，接收VR设备提供的信息，其中，信息用于计算使用VR设备的视野范围。
S13，根据信息从图像中提取视野范围内的图像。
S14，将视野范围内的图像发送给VR设备。
在本实施例中，上述机器可读介质可以包括但不限于：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
在本实施例中，处理器可以根据机器可读介质中已存储的程序代码执行：根据信息从图像中截取视野范围内的图像；降低视野范围内的图像的边缘的分辨率；将降低了分辨率的视野范围内的图像发送给VR设备。
在本实施例中，处理器可以根据机器可读介质中已存储的程序代码执行：根据人眼敏感区的范围划分出视野范围内的图像的边缘。
在本实施例中，处理器可以根据机器可读介质中已存储的程序代码执行： 获取视频数据中的左眼视频和右眼视频，并从左眼视频和右眼视频中分别解析出对应帧的图像；分别从左眼视频对应的图像和右眼视频对应的图像中提取视野范围内的图像。
在本实施例中，处理器可以根据机器可读介质中已存储的程序代码执行：在VR设备仅有一个屏幕的情况下，将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像进行左右结合；将结合之后的视野范围内的图像发送给VR设备。
在本实施例中，处理器可以根据机器可读介质中已存储的程序代码执行：在VR设备有两个屏幕的情况下，将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像分别发送给VR设备。
在本实施例中，处理器可以根据机器可读介质中已存储的程序代码执行：通过WIFI将视野范围内的图像发送给VR设备。
实施例四
本发明实施例提供的机器可读介质还可以被设置为存储用于执行以下步骤的程序代码：
S21，与机顶盒建立连接。
S22，向机顶盒发送信息，其中，信息用于计算使用VR设备的视野范围。
S23，从机顶盒接收视野范围内的图像。
S24，播放视野范围内的图像。
在本实施例中，处理器可以根据机器可读介质中已存储的程序代码执行：从机顶盒接收左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像；将左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像进行左右结合之后进行播放；或者，在两个屏幕中分别播放左眼视频对应的视野范围内的图像和右眼视频对应的视野范围内的图像。
在本实施例中，处理器可以根据机器可读介质中已存储的程序代码执行：通过WIFI从机顶盒接收视野范围内的图像。
本实施例中的示例可以参考上述实施例及示例性实施方式中所描述的示例，本实施例在此不再赘述。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在机器可读介质(比如，计算机可读介质)上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
以上所述仅为本申请的示例性实施例而已，并不用于限制本申请，对于本领域的技术人员来说，本申请可以有各种更改和变化。凡在本申请的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本申请的保护范围之内。
工业实用性
本申请实施例提供一种视频处理方法、视频播放方法、机顶盒以及VR设备，解决了相关技术中VR设备播放视频时需要传输的数据量太大造成的播放卡顿的问题，达到了提高VR设备播放视频的流畅性的技术效果。

Claims (24)

  1. 一种视频处理方法，包括：
    从接收到的视频数据中解析出帧的图像；
    接收虚拟现实VR设备提供的信息，其中，所述信息用于计算使用所述VR设备的视野范围；
    根据所述信息从所述图像中提取所述视野范围内的图像；
    将所述视野范围内的图像发送给所述VR设备。
  2. 根据权利要求1所述的方法，其中，所述根据所述信息从所述图像中提取所述视野范围内的图像，并将所述视野范围内的图像发送给所述VR设备，包括：
    根据所述信息从所述图像中截取所述视野范围内的图像；
    降低所述视野范围内的图像的边缘的分辨率；
    将降低了分辨率的所述视野范围内的图像发送给所述VR设备。
  3. 根据权利要求2所述的方法，其中，所述根据所述信息从所述图像中截取所述视野范围内的图像，包括：根据人眼敏感区的范围划分出所述视野范围内的图像的边缘。
  4. 根据权利要求1所述的方法，其中，所述从接收到的视频数据中解析出帧的图像包括：获取所述视频数据中的左眼视频和右眼视频，并从所述左眼视频和所述右眼视频中分别解析出对应所述帧的图像；
    所述根据所述信息从所述图像中提取所述视野范围内的图像包括：分别从所述左眼视频对应的图像和所述右眼视频对应的图像中提取所述视野范围内的图像。
  5. 根据权利要求4所述的方法，其中，所述将所述视野范围内的图像发送给所述VR设备包括：
    在所述VR设备仅有一个屏幕的情况下，将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像进行左右结合；
    将结合之后的所述视野范围内的图像发送给所述VR设备。
  6. 根据权利要求4所述的方法，其中，所述将所述视野范围内的图像发送给所述VR设备包括：
    在所述VR设备有两个屏幕的情况下，将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像分别发送给所述VR设备。
  7. 根据权利要求1至6中任一项所述的方法，其中，所述VR设备提供的信息包括以下至少之一：所述VR设备的视觉距离、所述VR设备的轴向角度、所述VR设备的位置。
  8. 根据权利要求1至6中任一项所述的方法，其中，所述将所述视野范围内的图像发送给所述VR设备包括：
    通过无线保真WIFI将所述视野范围内的图像发送给所述VR设备。
  9. 一种视频播放方法，包括：
    与机顶盒建立连接；
    向所述机顶盒发送信息，其中，所述信息用于计算使用虚拟现实VR设备的视野范围；
    从所述机顶盒接收所述视野范围内的图像；
    播放所述视野范围内的图像。
  10. 根据权利要求9所述的方法，其中，所述从所述机顶盒接收所述视野范围内的图像包括：从所述机顶盒接收左眼视频对应的所述视野范围内的图像和右眼视频对应的所述视野范围内的图像；
    所述播放所述视野范围内的图像包括：将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像进行左右结合之后进行播放；或者，在两个屏幕中分别播放所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像。
  11. 根据权利要求9或10所述的方法，其中，所述向所述机顶盒发送的信息包括以下至少之一：所述VR设备的视觉距离、所述VR设备的轴向角度、所述VR设备的位置。
  12. 根据权利要求9或10所述的方法，其中，所述从所述机顶盒接收所述视野范围内的图像包括：
    通过无线保真WIFI从所述机顶盒接收所述视野范围内的图像。
  13. 一种机顶盒，包括：
    接收模块，配置为从接收到的视频数据中解析出帧的图像；
    第一无线通信模块，配置为接收虚拟现实VR设备提供的信息，其中，所述信息用于计算使用所述VR设备的视野范围；
    视频处理模块，配置为根据所述信息从所述图像中提取所述视野范围内的图像；
    第二无线通信模块，配置为将所述视野范围内的图像发送给所述VR设备。
  14. 根据权利要求13所述的机顶盒，其中，所述视频处理模块配置为根据所述信息从所述图像中截取所述视野范围内的图像，降低所述视野范围内的图像的边缘的分辨率；
    所述第二无线通信模块配置为将降低了分辨率的所述视野范围内的图像发送给所述VR设备。
  15. 根据权利要求14所述的机顶盒，其中，所述视频处理模块配置为根据人眼敏感区的范围划分出所述视野范围内的图像的边缘。
  16. 根据权利要求13所述的机顶盒，其中，所述接收模块配置为获取所述视频数据中的左眼视频和右眼视频，并从所述左眼视频和所述右眼视频中分别解析出对应所述帧的图像；
    所述视频处理模块配置为分别从所述左眼视频对应的图像和所述右眼视频对应的图像中提取所述视野范围内的图像。
  17. 根据权利要求16所述的机顶盒，其中，在所述VR设备仅有一个屏幕的情况下，所述第二无线通信模块配置为将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像进行左右结合；将结合之后的所述视野范围内的图像发送给所述VR设备。
  18. 根据权利要求16所述的机顶盒，其中，在所述VR设备有两个屏幕的情况下，所述第二无线通信模块配置为将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像分别发送给所述VR设备。
  19. 根据权利要求13至18中任一项所述的机顶盒，其中，所述VR设备提供的信息包括以下至少之一：所述VR设备的视觉距离、所述VR设备的轴向角度、所述VR设备的位置。
  20. 根据权利要求13至18中任一项所述的机顶盒，其中，所述第二无线通信模块配置为通过无线保真WIFI将所述视野范围内的图像发送给所述VR设备。
  21. 一种虚拟现实VR设备，包括：
    第三无线通信模块，配置为与机顶盒建立连接；
    第四无线通信模块，配置为向所述机顶盒发送信息，其中，所述信息用于计算使用VR设备的视野范围；
    第五无线通信模块，配置为从所述机顶盒接收所述视野范围内的图像；
    视频播放模块，配置为播放所述视野范围内的图像。
  22. 根据权利要求21所述的VR设备，其中，所述第五无线通信模块配置为从所述机顶盒接收左眼视频对应的所述视野范围内的图像和右眼视频对应的所述视野范围内的图像；
    所述视频播放模块配置为将所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像进行左右结合之后进行播放；或者，在两个屏幕中分别播放所述左眼视频对应的所述视野范围内的图像和所述右眼视频对应的所述视野范围内的图像。
  23. 根据权利要求21或22所述的VR设备，所述VR设备还包括：
    位置获取模块，配置为获取所述VR设备的视觉距离、所述VR设备的轴向角度、所述VR设备的位置。
  24. 根据权利要求21或22所述的VR设备，其中，所述第五无线通信模块配置为通过无线保真WIFI从所述机顶盒接收所述视野范围内的图像。
PCT/CN2017/084541 2016-05-18 2017-05-16 视频处理方法、视频播放方法、机顶盒以及vr设备 WO2017198143A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610332569.7 2016-05-18
CN201610332569.7A CN107404641A (zh) 2016-05-18 2016-05-18 视频处理方法、视频播放方法、机顶盒以及vr设备

Publications (1)

Publication Number Publication Date
WO2017198143A1 true WO2017198143A1 (zh) 2017-11-23

Family

ID=60325697

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/084541 WO2017198143A1 (zh) 2016-05-18 2017-05-16 视频处理方法、视频播放方法、机顶盒以及vr设备

Country Status (2)

Country Link
CN (1) CN107404641A (zh)
WO (1) WO2017198143A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110703913A (zh) * 2019-09-27 2020-01-17 腾讯科技（深圳）有限公司 对象交互方法和装置、存储介质及电子装置
CN111698513A (zh) * 2020-05-22 2020-09-22 深圳威尔视觉传媒有限公司 图像采集方法、显示方法、装置、电子设备及存储介质
CN111970552A (zh) * 2020-08-04 2020-11-20 深圳市佳创视讯技术股份有限公司 一种基于机顶盒实时播放dvb全景视频流的方法及系统

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109587470A (zh) * 2018-10-23 2019-04-05 嘉兴玄视信息科技有限公司 一种基于虚拟现实一体机的3d电视及一体机控制系统
CN111107293B (zh) * 2019-12-16 2022-07-01 咪咕文化科技有限公司 360度视频录制方法、装置、电子设备及存储介质
CN112184918A (zh) * 2020-09-15 2021-01-05 福建师范大学协和学院 基于电商的虚拟旅游方法、装置、计算机设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104735464A (zh) * 2015-03-31 2015-06-24 华为技术有限公司 一种全景视频交互传输方法、服务器和客户端
CN105323552A (zh) * 2015-10-26 2016-02-10 北京时代拓灵科技有限公司 一种全景视频播放方法及系统
CN105338272A (zh) * 2015-11-27 2016-02-17 广东长虹电子有限公司 基于VR技术及Miracast技术的电视机
WO2016023642A1 (en) * 2014-08-15 2016-02-18 Sony Corporation Panoramic video

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101640767B1 (ko) * 2010-02-09 2016-07-29 삼성전자주식회사 이종 수행 환경을 위한 네트워크 기반의 실시간 가상 현실 입출력 시스템 및 가상 현실 입출력 방법
US10514541B2 (en) * 2012-12-27 2019-12-24 Microsoft Technology Licensing, Llc Display update time reduction for a near-eye display

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016023642A1 (en) * 2014-08-15 2016-02-18 Sony Corporation Panoramic video
CN104735464A (zh) * 2015-03-31 2015-06-24 华为技术有限公司 一种全景视频交互传输方法、服务器和客户端
CN105323552A (zh) * 2015-10-26 2016-02-10 北京时代拓灵科技有限公司 一种全景视频播放方法及系统
CN105338272A (zh) * 2015-11-27 2016-02-17 广东长虹电子有限公司 基于VR技术及Miracast技术的电视机

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110703913A (zh) * 2019-09-27 2020-01-17 腾讯科技（深圳）有限公司 对象交互方法和装置、存储介质及电子装置
CN110703913B (zh) * 2019-09-27 2023-09-26 腾讯科技（深圳）有限公司 对象交互方法和装置、存储介质及电子装置
CN111698513A (zh) * 2020-05-22 2020-09-22 深圳威尔视觉传媒有限公司 图像采集方法、显示方法、装置、电子设备及存储介质
CN111970552A (zh) * 2020-08-04 2020-11-20 深圳市佳创视讯技术股份有限公司 一种基于机顶盒实时播放dvb全景视频流的方法及系统

Also Published As

Publication number Publication date
CN107404641A (zh) 2017-11-28

Similar Documents

Publication Publication Date Title
WO2017198143A1 (zh) 视频处理方法、视频播放方法、机顶盒以及vr设备
US10943502B2 (en) Manipulation of media content to overcome user impairments
US20240214540A1 (en) Method for transmitting panoramic videos, terminal and server
US11245939B2 (en) Generating and transmitting metadata for virtual reality
KR101863767B1 (ko) 의사-3d 인위적 원근법 및 장치
EP3316589A1 (en) Video synchronization device and video synchronization method
CN106303573B (zh) 一种3d视频图像处理方法及服务器和客户端
US20120154526A1 (en) Stereo 3d video support in computing devices
US9578304B2 (en) Method and apparatus for processing and receiving digital broadcast signal for 3-dimensional subtitle
US11736673B2 (en) Methods and apparatus for capturing, processing and/or communicating images
WO2019157803A1 (zh) 传输控制方法
JP2015511780A (ja) ビデオ画像送信方法、装置及びシステム
US20190104330A1 (en) Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices
CN110798707B (zh) 传输媒体数据的方法、客户端和服务器
US20230360678A1 (en) Data processing method and storage medium
EP2590419A2 (en) Multi-depth adaptation for video content
CN108810574B (zh) 一种视频信息处理方法及终端
US20220303518A1 (en) Code stream processing method and device, first terminal, second terminal and storage medium
US9325963B2 (en) Device and method for rendering and delivering 3-D content
KR101347744B1 (ko) 영상 처리 장치 및 방법
KR101746538B1 (ko) 입체영상 처리 시스템, 입체영상 처리 방법 및 액정 안경
KR20130085811A (ko) Ｓｎｓ 정보를 이용한 파노라마 영상 인터페이스 제공 시스템 및 방법
US20240179327A1 (en) Virtual reality streaming system and method
KR101746539B1 (ko) 입체영상 처리 시스템, 입체영상 처리 방법 및 안경

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17798706

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17798706

Country of ref document: EP

Kind code of ref document: A1