WO2021121413A1 - Video pushing and transmission methods, angle of view synchronization method and apparatus, and storage medium - Google Patents

Video pushing and transmission methods, angle of view synchronization method and apparatus, and storage medium Download PDF

Info

Publication number
WO2021121413A1
WO2021121413A1 PCT/CN2020/137800 CN2020137800W WO2021121413A1 WO 2021121413 A1 WO2021121413 A1 WO 2021121413A1 CN 2020137800 W CN2020137800 W CN 2020137800W WO 2021121413 A1 WO2021121413 A1 WO 2021121413A1
Authority
WO
WIPO (PCT)
Prior art keywords
video resource
video
fov
mec server
pushing
Prior art date
Application number
PCT/CN2020/137800
Other languages
French (fr)
Chinese (zh)
Inventor
刘波
彭宏
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2021121413A1 publication Critical patent/WO2021121413A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242Synchronization processes, e.g. processing of PCR [Program Clock References]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W36/00Hand-off or reselection arrangements

Definitions

  • the present disclosure relates to the field of network video technology, in particular, to a video resource pushing method and module, a perspective synchronization method and module, a video resource transmission method and module, a VR master control terminal, and a cloud computing center Server, an MEC server and a computer-readable storage medium.
  • the present disclosure provides a method and module for pushing video resources, a method and module for viewing angle synchronization, a method and module for video resource transmission, a VR master control terminal, and a cloud computing center.
  • Server an MEC server and a computer-readable storage medium.
  • a method for pushing video resources is provided.
  • the method for pushing video resources is applied to the virtual reality VR master control terminal of a cloud computing center.
  • the method for pushing video resources includes:
  • a FOV synchronization method is provided.
  • the FOV synchronization method is applied to a cloud computing center server of a cloud computing center, and the FOV synchronization method includes:
  • the FOV synchronization information is transmitted to the MEC server accessed by the user terminal that has established a connection with the VR master control terminal.
  • a VR video resource transmission method the VR video resource transmission method is applied to an MEC server, and the VR video resource transmission method includes:
  • a video resource pushing module is provided, the video resource pushing module is applied to the virtual reality VR main control terminal of a cloud computing center, and the video resource pushing module includes:
  • the query unit is configured to query the mobile edge computing MEC server accessed by the user terminal that has established a connection with the current VR master terminal;
  • the video pushing unit is configured to push video resources to the MEC server.
  • a perspective FOV synchronization module is provided.
  • the FOV synchronization module is applied to a cloud computing center server of a cloud computing center, and the FOV synchronization module includes:
  • the data processing unit is configured to receive the switched FOV sent by the VR master control terminal and generate FOV synchronization information
  • the synchronization unit is configured to transmit the FOV synchronization information to the MEC server accessed by the user terminal that establishes a connection with the VR master control terminal.
  • a video resource transmission module is provided.
  • the video resource transmission module is applied to an MEC server, and the video resource transmission module includes:
  • the receiving unit is configured to receive the video resource pushed by the VR master control terminal through the above-mentioned video resource pushing method provided by the present disclosure
  • the rendering unit is configured to render the video resource in response to the request of the user terminal to pull the media stream to obtain the VR video resource;
  • the transmission unit is configured to transmit the VR video resource to the user terminal.
  • a VR master control terminal is provided, and the VR master control terminal includes:
  • a storage module on which an application program is stored
  • One or more processors when the application program is executed by the one or more processors, enable the one or more processors to implement the aforementioned video resource pushing method provided in the present disclosure.
  • a cloud computing center server includes:
  • a storage module on which an application program is stored
  • One or more processors when the application program is executed by the one or more processors, enable the one or more processors to implement the FOV synchronization method provided in the present disclosure.
  • an MEC server includes:
  • a storage module on which an application program is stored
  • One or more processors when the application program is executed by the one or more processors, enable the one or more processors to implement the aforementioned VR video resource transmission method provided by the present disclosure.
  • a computer-readable storage medium stores an executable program, and when the executable program is executed, one of the following methods can be implemented:
  • the video resource transmission method provided by the present disclosure.
  • FIG. 1 is a flowchart of an implementation manner of a video resource pushing method in the present disclosure
  • Figure 2 is a schematic diagram of cloud computing center and network architecture
  • FIG. 3 is a flowchart of another implementation manner of the video resource pushing method in the present disclosure.
  • FIG. 4 is a flowchart of another implementation manner of the video resource pushing method in the present disclosure.
  • FIG. 5 is a flowchart of still another implementation manner of the video resource pushing method in the present disclosure.
  • FIG. 6 is a flowchart of an embodiment of the FOV synchronization method in the present disclosure.
  • FIG. 7 is a flowchart of an implementation manner of a video resource transmission method in the present disclosure.
  • FIG. 8 is a flowchart of another implementation manner of the video resource transmission method in the present disclosure.
  • FIG. 9 is a schematic diagram of a video resource pushing module in the present disclosure.
  • FIG. 10 is a schematic diagram of the FOV synchronization module in the present disclosure.
  • Fig. 11 is a schematic diagram of a video resource transmission module in the present disclosure.
  • a method for pushing video resources is provided.
  • the method for pushing video resources is applied to the virtual reality VR master control terminal of a cloud computing center.
  • the method for pushing video resources includes:
  • step S110 query the mobile edge computing (MEC, Mobile Edge Computing) server accessed by the user terminal that has established a connection with the current VR master terminal;
  • MEC Mobile Edge Computing
  • step S120 the video resource is pushed to the MEC server.
  • the cloud computing center transmits video resources through a 5G network.
  • the 5G network has multiple MEC servers, and each MEC server has certain computing, storage, and processing capabilities, so that the video resources pushed in the present disclosure can be stored and video rendering can be provided for user terminals.
  • the user terminal When the user terminal establishes a connection with the cloud computing center, it needs to register to the cloud computing center and the MEC server at the same time, and establish a connection with the VR master terminal of the cloud computing center.
  • the VR master control terminal in the present disclosure does not directly push the video resources to the user terminal, but in step S110, it is determined through a query that the user terminal that has established a connection with the current VR master control terminal is accessed And in step S120, push the video resource to the MEC server. After the video resource is pushed to the MEC server, the computing power of the MEC server is used to render the video resource to obtain the VR video resource, and then the MEC server transmits the rendered VR video resource to the user terminal.
  • step S110 is not particularly limited. For example, after creating a VR service on the VR master terminal, step S110 can be directly performed.
  • the VR master will provide a conference list to the user terminal that has established a connection with the current VR master.
  • the VR master will only join the conference.
  • the MEC node accessed by the user terminal of the conference pushes the video resource.
  • the MEC server accessed by the user terminal that is registered to the cloud computing center and the MEC server at the same time and establishes a connection with the VR master control terminal of the cloud computing center.
  • the VR service is a VR multi-party conference
  • different video resources are also pushed according to different conferences selected by the user terminal, so that the directional push of video resources is realized, thereby enhancing the privacy and privacy in the process of pushing video resources. safety.
  • the VR master control terminal does not need to push video resources to every user terminal or every MEC server, thereby reducing bandwidth consumption on the 5G core network.
  • the video resources pushed to the MEC server are unrendered video resources, that is, the cloud computing center does not render the video resources, and the MEC server renders the video resources and transmits them to the user
  • the terminal is no longer transmitted through the backbone network, thereby further reducing the consumption of network bandwidth and computing resources.
  • the user terminal directly obtains video resources from the MEC server, it overcomes the high latency and low reliability caused by multiple links, multiple network elements, and multiple networks when the user terminal interacts with the cloud computing center in the prior art. Sexual issues ensure the quality of VR services.
  • the video resource push method provided by the present disclosure directs and pushes unrendered video resources to the MEC server accessed by the user terminal, and the MEC server provides video rendering to the user terminal, so that the storage and rendering of video resources are closer to the user terminal, It can reduce the consumption of network bandwidth and computing resources, and reduce the network delay caused by the transmission and rendering of video resources, thereby ensuring the quality of VR services.
  • each MEC server can access multiple user terminals. Therefore, when the VR master pushes video resources to a certain MEC server in response to the application of the current user terminal, the MEC server may be The video resource to be pushed already exists in the previous application of the user terminal other than the user terminal.
  • the MEC server before pushing video resources to the MEC server, the MEC server is detected first, so as to avoid unnecessary waste of network bandwidth and computing resources caused by repeated push of video resources.
  • the video resource pushing method as shown in FIG. 3, before step S120, further includes:
  • step S130 it is detected whether there are video resources to be pushed to the user terminal on the MEC server;
  • step S120 is executed.
  • the user terminal can directly obtain the video resource from the MEC. At this time, the video resource is pushed The process ends.
  • the method for detecting whether there is a video resource to be pushed to the user terminal on the MEC server is not particularly limited, and it can be determined whether there is a video to be pushed to the user terminal on the MEC server. All resource methods belong to the protection scope of this disclosure.
  • step S130 may include:
  • step S131 it is detected whether there are historical video resources on the MEC server
  • step S132 is executed: detecting whether the historical video resource has timed out.
  • the historical video resource does not exist on the MEC server
  • the historical video resource exists on the MEC server, and the storage time of the historical video resource on the MEC server exceeds a predetermined time.
  • the time that the historical video resource is stored on the MEC server exceeds a predetermined time may be referred to as “the historical video resource has timed out”.
  • the determination condition for determining that the historical video resource on the MEC server has timed out For example, when the time of the historical video resource on the MEC server exceeds 1 min, it is determined that the historical video resource has timed out.
  • the VR master control terminal needs to switch the view FOV according to the business, and then needs to synchronize the FOV of the user terminal accessing the current VR service.
  • the video resource pushing method as shown in FIG. 5, after step S120, further includes:
  • step S140 the FOV information is sent to the cloud computing center server of the cloud computing center.
  • the FOV here refers to the current viewing angle of the object.
  • step S140 is performed after step S132.
  • step S140 can be further performed to synchronize. FOV.
  • a FOV synchronization method is provided.
  • the FOV synchronization method is applied to a cloud computing center server of a cloud computing center.
  • the FOV synchronization method includes:
  • step S210 receiving FOV information sent by the VR master control terminal and generating FOV synchronization information
  • step S220 the FOV synchronization information is transmitted to the MEC server accessed by the user terminal that has established a connection with the VR master terminal.
  • FOV synchronization information here refers to the synchronization control information obtained after coordinate conversion is performed according to the received FOV information.
  • the MEC server After receiving the FOV synchronization information, the MEC server can process the video when rendering the received video resource, so that the perspective of the VR video resource received by the user terminal can be consistent with the perspective of the VR master. In other words, through the FOV synchronization method, it can be ensured that the viewing angle of the VR video viewed by the user terminal is the same as the viewing angle of the VR master terminal, thereby improving user experience.
  • the FOV synchronization information is transmitted to the MEC server accessed by the user terminal that has established a connection with the VR master through the communication layer of the cloud computing center.
  • a VR video resource transmission method is provided.
  • the VR video resource transmission method is applied to an MEC server.
  • the video resource transmission method includes:
  • step S310 receiving the video resource pushed by the VR master through the aforementioned pushing method provided by the present disclosure
  • step S320 in response to the request of the user terminal to pull the media stream, the video resource is rendered to obtain the VR video resource;
  • step S330 the VR video resource is transmitted to the user terminal.
  • the "user terminal” here refers to a user terminal that accesses the current MEC server and establishes a connection with the VR master terminal.
  • the MEC server renders the video resource and transmits it to the user terminal instead of transmitting through the backbone network, thereby further reducing the consumption of network bandwidth and computing resources.
  • the user terminal directly obtains video resources from the MEC server, it overcomes the high latency and low reliability caused by multiple links, multiple network elements, and multiple networks when the user terminal interacts with the cloud computing center in the prior art. Sexual issues ensure the quality of VR services.
  • the FOV synchronization of the user terminal is also performed through the MEC server.
  • the video resource transmission method as shown in FIG. 8, after step S330, further includes:
  • step S340 receive the FOV synchronization information transmitted by the cloud computing center server
  • step S350 the FOV of the user terminal is synchronized according to the FOV synchronization information.
  • a video resource pushing module 100 is provided.
  • the video resource pushing module 100 is applied to the virtual reality VR master control terminal of a cloud computing center.
  • the video resource pushing module 100 includes a query unit 110 and a video push unit 120.
  • the video resource pushing module 100 provided in this aspect is configured to execute the video resource pushing method provided in the first aspect of the present disclosure, specifically:
  • the query unit 110 is configured to perform step S110, that is, the query unit 110 is configured to query the mobile edge computing MEC server accessed by the user terminal that has established a connection with the current VR master control terminal;
  • the video pushing unit 120 is configured to perform step S120, that is, the video pushing unit 120 is configured to push video resources to the MEC server.
  • a FOV synchronization module 200 is provided.
  • the FOV synchronization module 200 is applied to a cloud computing center server of a cloud computing center.
  • the FOV synchronization module 200 includes a data processing unit 210 and Sync unit 220.
  • the FOV synchronization module is set to execute the FOV synchronization method provided in the second aspect of the present disclosure, specifically:
  • the data processing unit 210 is configured to perform step S210, that is, the data processing unit 210 is configured to receive FOV information sent by the VR master control terminal and generate FOV synchronization information;
  • the synchronization unit 220 is configured to perform step S220, that is, the synchronization unit 220 is configured to transmit the FOV synchronization information to the MEC server accessed by the user terminal that establishes a connection with the VR master control terminal.
  • a video resource transmission module 300 is provided.
  • the video resource transmission module 300 is applied to an MEC server, as shown in FIG. 11.
  • the video resource transmission module 300 includes a receiving unit 310 and a rendering transmission unit 320. And transmission unit 330.
  • the receiving unit 310 is configured to perform step S310, that is, the receiving unit 310 is configured to receive the video resource pushed by the VR master through the video resource pushing method provided in the first aspect of the present disclosure;
  • the rendering unit 320 is configured to perform step S320, that is, the rendering unit 320 is configured to render the video resource in response to a request of the user terminal to pull a media stream;
  • the transmission unit 330 is configured to perform step S330, that is, the transmission unit 330 is configured to transmit the rendered video resource to the user terminal.
  • a VR master control terminal is provided, and the VR master control terminal includes:
  • a storage module stores an application program
  • One or more processors when the application program is executed by the one or more processors, enable the one or more processors to implement the video resource pushing method provided in the first aspect of the present disclosure.
  • a cloud computing center server includes:
  • a storage module stores an application program
  • One or more processors when the application program is executed by the one or more processors, enable the one or more processors to implement the FOV synchronization method provided in the second aspect of the present disclosure.
  • an MEC server includes:
  • a storage module stores an application program
  • One or more processors when the application program is executed by the one or more processors, enable the one or more processors to implement the aforementioned VR video resource transmission method provided by the present disclosure.
  • a computer-readable storage medium is provided, and an executable program is stored on the computer-readable storage medium.
  • the executable program is executed, the above-mentioned video resource pushing method and the above-mentioned Any one of the FOV synchronization method and the above-mentioned VR video resource transmission method.
  • the computer-readable storage medium includes volatile and non-volatile, removable and The media cannot be removed.
  • Computer-readable storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage media, Or any other medium that can be used to store desired information and that can be accessed by a computer.
  • the specific application scenarios of the video resource pushing method, the FOV synchronization method, and the VR video resource transmission method are not specifically limited.
  • the above method can be applied to VR video conferences.
  • the following describes in detail the video resource pushing method, the FOV synchronization method, and the VR video resource transmission method provided by the present disclosure in conjunction with specific scenarios of the VR video conference.
  • the process of the VR video conference is as follows:
  • the first step, user terminal access includes the following steps:
  • the user terminal (which can be a tablet computer, a desktop computer, a VR device, a smart phone, etc.) accesses the VR service and registers to the provider's cloud computing center;
  • the VR master control terminal of the cloud computing center establishes a connection with the user terminal
  • the user terminal is registered to the MEC server.
  • the second step is to establish a meeting, including the following steps:
  • the VR master control terminal After the user terminal accesses the cloud computing center on the VR service provider, the VR master control terminal creates a VR multi-party conference;
  • the user terminal queries the conference list created by the current VR master terminal
  • the user terminal selects the conference to join
  • the cloud computing center calls the user terminal, and the user terminal joins the conference.
  • the third step, VR control includes the following steps:
  • the VR master control terminal After successfully creating the meeting, the VR master control terminal applies for VR video resources from the resource server, and after obtaining relevant information of the video resources, pushes the VR media stream (that is, the video resources) to the MEC server;
  • the user terminal pulls VR video resources from the MEC server
  • the MEC server renders the video pushed by the VR master control terminal to obtain the VR video resource, and pushes the VR video resource to the user terminal.
  • the fourth step, FOV synchronization includes the following steps:
  • the VR master control terminal After the MEC server finishes rendering, the VR master control terminal will switch perspectives to display or introduce services according to business needs;
  • the VR master control terminal sends the FOV information to the cloud computing center server;
  • the cloud computing center server initiates FOV synchronization to all user terminals that access the VR conference, specifically, sends the FOV synchronization information to each MEC server through the communication layer;
  • the MEC server sends the rendered VR video to the terminal and synchronizes the FOV;

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A video resource pushing method and module, an angle of view synchronization method and module, a video resource transmission method and module, a VR master control end, a cloud computing center platform, a MEC server, and a computer readable storage medium. The video resource pushing method is applied to a virtual reality (VR) master control end of a cloud computer center, and the video resource pushing method comprises: querying a mobile edge computing (MEC) server with which the current VR master control end has established a connection and which is accessed by a user terminal (S110), and pushing a video resource to the MEC server (S120).

Description

视频推送及传输方法、视角同步方法及装置、存储介质Video push and transmission method, view angle synchronization method and device, and storage medium
相关申请的交叉引用Cross-references to related applications
本申请基于申请号为201911320510.6、申请日为2019年12月19日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。This application is based on a Chinese patent application with an application number of 201911320510.6 and an application date of December 19, 2019, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated into this application by reference.
技术领域Technical field
本公开涉及网络视频技术领域,具体地,涉及一种视频资源推送方法及模块、一种视角同步方法及模块、一种视频资源传输方法及模块、一种VR主控端、一种云计算中心服务器、一种MEC服务器和一种计算机可读存储介质。The present disclosure relates to the field of network video technology, in particular, to a video resource pushing method and module, a perspective synchronization method and module, a video resource transmission method and module, a VR master control terminal, and a cloud computing center Server, an MEC server and a computer-readable storage medium.
背景技术Background technique
在5G时代,用户可以享受高速率、低时延的网络体验。5G网络高速率、大容量、低时延的特征,为各种高清、超清视频类应用的大爆发提供了基础。但是随着虚拟现实(VR,Virtual Reality)、增强现实(AR,Augmented Reality)等对带宽有着巨大消耗的业务应用的不断增多,将会给5G网络带来巨大挑战。例如,对VR视频资源的渲染和视野(FOV,Field Of Vision)的同步都是在云计算中心进行,而当大量终端同时在5G网络中进行VR视频渲染和FOV同步,必然产生对带宽和计算资源的大量消耗,从而给5G核心网络带来巨大的风险,而且5G网络资源的大量消耗还会造成数据传输延迟的增加,使5G网络服务质量下降。In the 5G era, users can enjoy a high-speed, low-latency network experience. The high-speed, large-capacity, and low-latency characteristics of 5G networks provide the foundation for the explosion of various high-definition and ultra-definition video applications. However, with the increasing number of business applications that consume huge bandwidth, such as Virtual Reality (VR) and Augmented Reality (AR), it will bring huge challenges to 5G networks. For example, the rendering of VR video resources and the synchronization of Field Of Vision (FOV, Field Of Vision) are all performed in the cloud computing center. When a large number of terminals simultaneously perform VR video rendering and FOV synchronization on the 5G network, it will inevitably lead to bandwidth and computing The massive consumption of resources brings huge risks to the 5G core network, and the massive consumption of 5G network resources will also increase the data transmission delay and reduce the quality of 5G network services.
发明内容Summary of the invention
为解决上述问题的至少一个方面,本公开提供一种视频资源推送方法及模块、一种视角同步方法及模块、一种视频资源传输方法及模块、一种VR主控端、一种云计算中心服务器、一种MEC服务器和一种计算机可读存储介质。In order to solve at least one aspect of the above-mentioned problems, the present disclosure provides a method and module for pushing video resources, a method and module for viewing angle synchronization, a method and module for video resource transmission, a VR master control terminal, and a cloud computing center. Server, an MEC server and a computer-readable storage medium.
作为本公开的第一个方面,提供一种视频资源推送方法,所述视频资源推送方法应用于云计算中心的虚拟现实VR主控端,所述视频资源推送方法包括:As a first aspect of the present disclosure, a method for pushing video resources is provided. The method for pushing video resources is applied to the virtual reality VR master control terminal of a cloud computing center. The method for pushing video resources includes:
查询与所述VR主控端建立连接的用户终端所接入的移动边缘计算MEC服务器;以及Query the mobile edge computing MEC server accessed by the user terminal that has established a connection with the VR master terminal; and
向所述MEC服务器推送视频资源。Push video resources to the MEC server.
作为本公开的第二个方面,提供一种FOV同步方法,所述FOV同步方法应用于云计算中心的云计算中心服务器,所述FOV同步方法包括:As a second aspect of the present disclosure, a FOV synchronization method is provided. The FOV synchronization method is applied to a cloud computing center server of a cloud computing center, and the FOV synchronization method includes:
接收VR主控端发送的FOV信息并生成FOV同步信息;以及Receive FOV information sent by the VR master control terminal and generate FOV synchronization information; and
将所述FOV同步信息传输到与所述VR主控端建立连接的用户终端所接入的MEC服务器。The FOV synchronization information is transmitted to the MEC server accessed by the user terminal that has established a connection with the VR master control terminal.
作为本公开的第三个方面,一种VR视频资源传输方法,所述VR视频资源传输方法应用于MEC服务器,所述VR视频资源传输方法包括:As a third aspect of the present disclosure, a VR video resource transmission method, the VR video resource transmission method is applied to an MEC server, and the VR video resource transmission method includes:
接收VR主控端通过本公开所提供的上述推送方法推送的视频资源;Receiving the video resources pushed by the VR master through the aforementioned pushing method provided by the present disclosure;
响应于所述用户终端拉取媒体流的请求,对所述视频资源进行渲染,以获得VR视频资源;以及In response to the request of the user terminal to pull the media stream, rendering the video resource to obtain the VR video resource; and
将所述VR视频资源传输给所述用户终端。Transmitting the VR video resource to the user terminal.
作为本公开的第四个方面,提供一种视频资源推送模块,所述视频资源推送模块应用于云计算中心的虚拟现实VR主控端,所述视频资源推送模块包括:As a fourth aspect of the present disclosure, a video resource pushing module is provided, the video resource pushing module is applied to the virtual reality VR main control terminal of a cloud computing center, and the video resource pushing module includes:
查询单元,被设置为查询与当前VR主控端建立连接的用户终端所接入的移动边缘计算MEC服务器;以及The query unit is configured to query the mobile edge computing MEC server accessed by the user terminal that has established a connection with the current VR master terminal; and
视频推送单元,被设置为向所述MEC服务器推送视频资源。The video pushing unit is configured to push video resources to the MEC server.
作为本公开的第五个方面,提供一种视角FOV同步模块,所述FOV同步模块应用于云计算中心的云计算中心服务器,所述FOV同步模块包括:As a fifth aspect of the present disclosure, a perspective FOV synchronization module is provided. The FOV synchronization module is applied to a cloud computing center server of a cloud computing center, and the FOV synchronization module includes:
数据处理单元,被设置为接收VR主控端发送的切换后的FOV并生成FOV同步信息;以及The data processing unit is configured to receive the switched FOV sent by the VR master control terminal and generate FOV synchronization information; and
同步单元,被设置为将所述FOV同步信息传输到与所述VR主控端建立连接的用户终端接入的MEC服务器。The synchronization unit is configured to transmit the FOV synchronization information to the MEC server accessed by the user terminal that establishes a connection with the VR master control terminal.
作为本公开的第六个方面,提供一种视频资源传输模块,所述视频资源传输模块应用于MEC服务器,所述视频资源传输模块包括:As a sixth aspect of the present disclosure, a video resource transmission module is provided. The video resource transmission module is applied to an MEC server, and the video resource transmission module includes:
接收单元,被设置为接收VR主控端通过本公开所提供的上述视频资源推送方法所推送的视频资源;The receiving unit is configured to receive the video resource pushed by the VR master control terminal through the above-mentioned video resource pushing method provided by the present disclosure;
渲染单元,被设置为响应于所述用户终端拉取媒体流的请求,对所述视频资源进行渲染,以获得VR视频资源;以及The rendering unit is configured to render the video resource in response to the request of the user terminal to pull the media stream to obtain the VR video resource; and
传输单元,被设置为将所述VR视频资源传输到所述用户终端。The transmission unit is configured to transmit the VR video resource to the user terminal.
作为本公开的第七个方面,提供一种VR主控端,所述VR主控端包括:As a seventh aspect of the present disclosure, a VR master control terminal is provided, and the VR master control terminal includes:
存储模块,所述存储模块上存储有应用程序;以及A storage module on which an application program is stored; and
一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现本公开所提供的上述视频资源推送方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the aforementioned video resource pushing method provided in the present disclosure.
作为本公开的第八个方面,提供一种云计算中心服务器,所述云计算中心服务器包括:As an eighth aspect of the present disclosure, a cloud computing center server is provided, and the cloud computing center server includes:
存储模块,所述存储模块上存储有应用程序;以及A storage module on which an application program is stored; and
一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现本公开所提供的上述FOV同步方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the FOV synchronization method provided in the present disclosure.
作为本公开的第九个方面,提供一种MEC服务器,所述MEC服务器包括:As a ninth aspect of the present disclosure, an MEC server is provided, and the MEC server includes:
存储模块,所述存储模块上存储有应用程序;以及A storage module on which an application program is stored; and
一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现本公开所提供的上述VR视频资源传输方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the aforementioned VR video resource transmission method provided by the present disclosure.
作为本公开的第十个方面,提供一种计算机可读存储介质,所述计算机可读存储介质上存储有可执行程序,所述可执行程序被执行时能够实现以下方法中的一者:As a tenth aspect of the present disclosure, a computer-readable storage medium is provided, the computer-readable storage medium stores an executable program, and when the executable program is executed, one of the following methods can be implemented:
本公开所提供的视频资源推送方法;The video resource push method provided by the present disclosure;
本公开所提供的FOV同步方法;以及The FOV synchronization method provided by the present disclosure; and
本公开所提供的视频资源传输方法。The video resource transmission method provided by the present disclosure.
附图说明Description of the drawings
附图是用来提供对本公开的进一步理解,并且构成说明书的一部分,与下面的具体实施方式一起用于解释本公开,但并不构成对本公开的限制。在附图中:The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present disclosure, but do not constitute a limitation to the present disclosure. In the attached picture:
图1是本公开中视频资源推送方法的一种实施方式的流程图;FIG. 1 is a flowchart of an implementation manner of a video resource pushing method in the present disclosure;
图2是云计算中心和网络架构示意图;Figure 2 is a schematic diagram of cloud computing center and network architecture;
图3是本公开中视频资源推送方法的另一种实施方式的流程图;FIG. 3 is a flowchart of another implementation manner of the video resource pushing method in the present disclosure;
图4是本公开中视频资源推送方法的又一种实施方式的流程图;FIG. 4 is a flowchart of another implementation manner of the video resource pushing method in the present disclosure;
图5是本公开中视频资源推送方法的再一种实施方式的流程图;FIG. 5 is a flowchart of still another implementation manner of the video resource pushing method in the present disclosure;
图6是本公开中FOV同步方法的一种实施方式的流程图;FIG. 6 is a flowchart of an embodiment of the FOV synchronization method in the present disclosure;
图7是本公开中视频资源传输方法的一种实施方式的流程图;FIG. 7 is a flowchart of an implementation manner of a video resource transmission method in the present disclosure;
图8是本公开中视频资源传输方法的另一种实施方式的流程图;FIG. 8 is a flowchart of another implementation manner of the video resource transmission method in the present disclosure;
图9是本公开中视频资源推送模块的模块示意图;FIG. 9 is a schematic diagram of a video resource pushing module in the present disclosure;
图10是本公开中FOV同步模块的模块示意图;FIG. 10 is a schematic diagram of the FOV synchronization module in the present disclosure;
图11是本公开中视频资源传输模块的模块示意图。Fig. 11 is a schematic diagram of a video resource transmission module in the present disclosure.
具体实施方式Detailed ways
以下结合附图对本公开的具体实施方式进行详细说明。应当理解的是,此处所描述的具体实施方式仅用于说明和解释本公开,并不用于限制本公开。The specific embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present disclosure, and are not used to limit the present disclosure.
作为本公开的第一个方面,提供一种视频资源推送方法,所述视频资源推送方法应用于云计算中心的虚拟现实VR主控端,如图1所示,所述视频资源推送方法包括:As a first aspect of the present disclosure, a method for pushing video resources is provided. The method for pushing video resources is applied to the virtual reality VR master control terminal of a cloud computing center. As shown in FIG. 1, the method for pushing video resources includes:
在步骤S110中,查询与当前VR主控端建立连接的用户终端所接入的移动边缘计算(MEC,Mobile Edge Computing)服务器;In step S110, query the mobile edge computing (MEC, Mobile Edge Computing) server accessed by the user terminal that has established a connection with the current VR master terminal;
在步骤S120中,向所述MEC服务器推送视频资源。In step S120, the video resource is pushed to the MEC server.
在本公开中,云计算中心通过5G网络进行视频资源的传输。如图2所示,5G网络具有多个MEC服务器,每个MEC服务器都具有一定的计算、存储和处理能力,从而可以对本公开中推送的视频资源进行存储,并为用户终端提供视频渲染。In this disclosure, the cloud computing center transmits video resources through a 5G network. As shown in Figure 2, the 5G network has multiple MEC servers, and each MEC server has certain computing, storage, and processing capabilities, so that the video resources pushed in the present disclosure can be stored and video rendering can be provided for user terminals.
当用户终端与云计算中心建立连接时,需要同时注册到云计算中心和MEC服务器,并与云计算中心的VR主控端建立连接。当需要推送视频资源时,本公开中的VR主控端并不是将视频资源直接推送给用户终端,而是在步骤S110中,通过查询确定与当前VR主控端建立连接的用户终端所接入的MEC服务器,并在步骤S120中,将视频资源推送到所述MEC服务器上。将所述视频资源推送到MEC服务器上之后,利用所述MEC服务器的计算能力对视频资源进行渲染,获得VR视频资源,再由MEC服务器将渲染后获得的VR视频资源传输至所述用户终端。When the user terminal establishes a connection with the cloud computing center, it needs to register to the cloud computing center and the MEC server at the same time, and establish a connection with the VR master terminal of the cloud computing center. When it is necessary to push video resources, the VR master control terminal in the present disclosure does not directly push the video resources to the user terminal, but in step S110, it is determined through a query that the user terminal that has established a connection with the current VR master control terminal is accessed And in step S120, push the video resource to the MEC server. After the video resource is pushed to the MEC server, the computing power of the MEC server is used to render the video resource to obtain the VR video resource, and then the MEC server transmits the rendered VR video resource to the user terminal.
在本公开中,对执行步骤S110的具体时机不做特殊的限定,例如,可以在VR主控端创建VR服务后,直接执行步骤S110。In the present disclosure, the specific timing of performing step S110 is not particularly limited. For example, after creating a VR service on the VR master terminal, step S110 can be directly performed.
也可以在VR主控终端创建VR服务、并响应于用户终端接入VR服务后,再执行步骤S110。当所述VR服务为VR多方会议时,VR主控端会向与当前VR主控端建立连接的用户终端提供会议列表,当用户选择并加入某一会议后,VR主控端只向加入该会议的用户终端所接入的MEC节点推送视频资源。It is also possible to create a VR service at the VR master control terminal and perform step S110 after responding to the user terminal accessing the VR service. When the VR service is a VR multi-party conference, the VR master will provide a conference list to the user terminal that has established a connection with the current VR master. When the user selects and joins a conference, the VR master will only join the conference. The MEC node accessed by the user terminal of the conference pushes the video resource.
由此可见,在本公开中,仅向同时注册到云计算中心和MEC服务器、且与云计算中心的VR主控端建立连接的用户终端所接入的MEC服务器推送视频资源。在一些实施例中,当VR服务为VR多方会议时,还根据用户终端选择的不同会议,推送不同的视频资源,实现了视频资源的定向推送,从而增强了视频资源推送过程中的隐私性和安全性。同时,由于上述视频资源的定向推送,VR主控端不需要向每一个用户终端或每一个MEC服务器推送视频资源,从而降低了对5G核心网络的带宽消耗。It can be seen that, in the present disclosure, only the MEC server accessed by the user terminal that is registered to the cloud computing center and the MEC server at the same time and establishes a connection with the VR master control terminal of the cloud computing center. In some embodiments, when the VR service is a VR multi-party conference, different video resources are also pushed according to different conferences selected by the user terminal, so that the directional push of video resources is realized, thereby enhancing the privacy and privacy in the process of pushing video resources. safety. At the same time, due to the directional push of the above-mentioned video resources, the VR master control terminal does not need to push video resources to every user terminal or every MEC server, thereby reducing bandwidth consumption on the 5G core network.
如上文中所述,在本公开的步骤S120中,推送到MEC服务器的视频资源是未经渲染的视频资源,即云计算中心不对视频资源进行渲染,由MEC服务器对视频资源进行渲染并传输至用户终端,而不再通过主干网络进行传输,从而进一步降低了对网络带宽和计算资源的消耗。同时由于用户终端直接从MEC服务器获取视频资源,克服了现有技术中用户终端与云计算中心进行交互时需要经过多条链路、多个网元、多个网络造成的高时延、低可靠性的问题,确保了VR服务的质量。As described above, in step S120 of the present disclosure, the video resources pushed to the MEC server are unrendered video resources, that is, the cloud computing center does not render the video resources, and the MEC server renders the video resources and transmits them to the user The terminal is no longer transmitted through the backbone network, thereby further reducing the consumption of network bandwidth and computing resources. At the same time, because the user terminal directly obtains video resources from the MEC server, it overcomes the high latency and low reliability caused by multiple links, multiple network elements, and multiple networks when the user terminal interacts with the cloud computing center in the prior art. Sexual issues ensure the quality of VR services.
本公开提供的视频资源推送方法,将未经渲染的视频资源定向推送到用户终端接入的MEC服务器,并由MEC服务器向用户终端提供视频渲染,使得视频资源的存储和渲染更加靠近用户终端,能够降低对网络带宽和计算资源的消耗,降低视频资源传输和渲染造成的网络延迟,从而确保VR服务质量。The video resource push method provided by the present disclosure directs and pushes unrendered video resources to the MEC server accessed by the user terminal, and the MEC server provides video rendering to the user terminal, so that the storage and rendering of video resources are closer to the user terminal, It can reduce the consumption of network bandwidth and computing resources, and reduce the network delay caused by the transmission and rendering of video resources, thereby ensuring the quality of VR services.
在本公开中,每个MEC服务器上都可以接入多个用户终端,因此,当VR主控端响应于当前用户终端的申请向某一MEC服务器推送视频资源时,该MEC服务器上可能因为当前用户终端以外的用户终端的在先申请已经存在待推送的视频资源。在本公中,向MEC服务器推送视频资源之前,先对该MEC服务器进行检测,从而避免重复推送视频资源而造成对网络带宽和计算资源的不必要浪费。相应地,所述视频资源推送方法除了包括上述步骤S110和步骤S120以外,如图3所示,在步骤S120之前,还包括:In this disclosure, each MEC server can access multiple user terminals. Therefore, when the VR master pushes video resources to a certain MEC server in response to the application of the current user terminal, the MEC server may be The video resource to be pushed already exists in the previous application of the user terminal other than the user terminal. In this publication, before pushing video resources to the MEC server, the MEC server is detected first, so as to avoid unnecessary waste of network bandwidth and computing resources caused by repeated push of video resources. Correspondingly, in addition to the above-mentioned step S110 and step S120, the video resource pushing method, as shown in FIG. 3, before step S120, further includes:
在步骤S130中,检测所述MEC服务器上是否存在待推送至所述用户终端的视频资源;In step S130, it is detected whether there are video resources to be pushed to the user terminal on the MEC server;
若所述MEC服务器上不存在所述待推送至所述用户终端的视频资源,执行步骤S120。If the video resource to be pushed to the user terminal does not exist on the MEC server, step S120 is executed.
需要说明的是,当通过执行步骤S130发现所述MEC服务器上存在待推送至所述用户终端的视频资源,用户终端就可以直接从所述MEC上获取该视频资源,此时,推送视频资源的流程结束。It should be noted that, when it is found that there is a video resource to be pushed to the user terminal on the MEC server by performing step S130, the user terminal can directly obtain the video resource from the MEC. At this time, the video resource is pushed The process ends.
在本公开中,对于检测所述MEC服务器上是否存在待推送至所述用户终端的视频资源的方法不做特殊限定,凡是能够确定所述MEC服务器上是否存在待推送至所述用户终端的视频资源的方法都属于本公开的保护范围。In this disclosure, the method for detecting whether there is a video resource to be pushed to the user terminal on the MEC server is not particularly limited, and it can be determined whether there is a video to be pushed to the user terminal on the MEC server. All resource methods belong to the protection scope of this disclosure.
在一些实施例中,如图4所示,步骤S130可以包括:In some embodiments, as shown in FIG. 4, step S130 may include:
在步骤S131中,检测所述MEC服务器上是否存在历史视频资源;In step S131, it is detected whether there are historical video resources on the MEC server;
若所述MEC服务器上存在所述历史视频资源,则执行步骤S132:检测该历史视频资源是否超时。If the historical video resource exists on the MEC server, step S132 is executed: detecting whether the historical video resource has timed out.
当满足以下条件中的任意一者时,判定所述MEC服务器上不存在所述待推送至所述用户终端的视频资源:When any one of the following conditions is met, it is determined that the video resource to be pushed to the user terminal does not exist on the MEC server:
所述MEC服务器上不存在所述历史视频资源;The historical video resource does not exist on the MEC server;
所述MEC服务器上存在所述历史视频资源、且所述历史视频资源在所述MEC服务器上存储的时间超过预定时间。The historical video resource exists on the MEC server, and the storage time of the historical video resource on the MEC server exceeds a predetermined time.
为了便于描述,可以将“所述历史视频资源在所述MEC服务器上存储的时间超过预定时间”称为“所述历史视频资源已超时”。For ease of description, "the time that the historical video resource is stored on the MEC server exceeds a predetermined time" may be referred to as "the historical video resource has timed out".
在本公开中,对判定所述MEC服务器上的历史视频资源已超时的判定条件不做特殊限定。例如,当所述MEC服务器上的历史视频资源的时间超过1min时,判定该历史视频资 源超时。In the present disclosure, there is no special limitation on the determination condition for determining that the historical video resource on the MEC server has timed out. For example, when the time of the historical video resource on the MEC server exceeds 1 min, it is determined that the historical video resource has timed out.
在VR服务的实际应用中,VR主控端需要根据业务对视角FOV进行切换,进而需要对接入当前VR服务的用户终端的FOV进行同步。相应地,所述视频资源推送方法除了包括上述步骤S110和步骤S120以外,如图5所示,在步骤S120之后,还包括:In the actual application of the VR service, the VR master control terminal needs to switch the view FOV according to the business, and then needs to synchronize the FOV of the user terminal accessing the current VR service. Correspondingly, in addition to the above-mentioned steps S110 and S120, the video resource pushing method, as shown in FIG. 5, after step S120, further includes:
在步骤S140中,将FOV信息发送到所述云计算中心的云计算中心服务器。In step S140, the FOV information is sent to the cloud computing center server of the cloud computing center.
需要指出的是,此处的FOV是指物体当前的展示视角。It should be pointed out that the FOV here refers to the current viewing angle of the object.
在一些实施例中,在如图4所示,上述步骤S140在步骤S132之后执行。执行步骤S131发现所述MEC服务器上存在所述历史视频资源,然后执行S132发现所述MEC服务器上的所述历史视频资源未超时,此时,推送视频资源的流程结束,可以进一步执行步骤S140同步FOV。In some embodiments, as shown in FIG. 4, the above-mentioned step S140 is performed after step S132. Perform step S131 to find that the historical video resource exists on the MEC server, and then perform S132 to find that the historical video resource on the MEC server has not timed out. At this time, the process of pushing video resources ends, and step S140 can be further performed to synchronize. FOV.
需要说明的是,在实际应用中,可以对本公开实施例中提供的各视频资源推送方法中的不同步骤进行组合,以得到新的技术方案,该新的技术方案也应属于本公开的保护范围。It should be noted that in practical applications, different steps in the video resource pushing methods provided in the embodiments of the present disclosure can be combined to obtain a new technical solution, which should also fall within the protection scope of the present disclosure. .
作为本公开的第二个方面,提供一种FOV同步方法,所述FOV同步方法应用于云计算中心的云计算中心服务器,如图6所示,所述FOV同步方法包括:As a second aspect of the present disclosure, a FOV synchronization method is provided. The FOV synchronization method is applied to a cloud computing center server of a cloud computing center. As shown in FIG. 6, the FOV synchronization method includes:
在步骤S210中,接收VR主控端发送的FOV信息并生成FOV同步信息;In step S210, receiving FOV information sent by the VR master control terminal and generating FOV synchronization information;
在步骤S220中,将所述FOV同步信息传输到与所述VR主控端建立连接的用户终端所接入的MEC服务器。In step S220, the FOV synchronization information is transmitted to the MEC server accessed by the user terminal that has established a connection with the VR master terminal.
需要指出的是,此处的“FOV同步信息”是指,根据接收到的FOV信息进行坐标转换后获得的同步控制信息。It should be pointed out that the "FOV synchronization information" here refers to the synchronization control information obtained after coordinate conversion is performed according to the received FOV information.
MEC服务器在接收到FOV同步信息后,可以在对接收到的视频资源进行渲染时,对视频进行相应处理,从而可以使得用户终端接收到的VR视频资源的视角与VR主控端的视角一致。换言之,通过所述FOV同步方法,可以确保用户终端看到的VR视频的视角与VR主控端的视角相同,提高用户体验。After receiving the FOV synchronization information, the MEC server can process the video when rendering the received video resource, so that the perspective of the VR video resource received by the user terminal can be consistent with the perspective of the VR master. In other words, through the FOV synchronization method, it can be ensured that the viewing angle of the VR video viewed by the user terminal is the same as the viewing angle of the VR master terminal, thereby improving user experience.
在执行步骤S220的一些实施例中,通过所述云计算中心的通信层将所述FOV同步信息传输到与所述VR主控端建立连接的用户终端接入的MEC服务器。In some embodiments where step S220 is performed, the FOV synchronization information is transmitted to the MEC server accessed by the user terminal that has established a connection with the VR master through the communication layer of the cloud computing center.
作为本公开的第三个方面,提供一种VR视频资源传输方法,所述VR视频资源传输方法应用于MEC服务器,如图7所示,所述视频资源传输方法包括:As a third aspect of the present disclosure, a VR video resource transmission method is provided. The VR video resource transmission method is applied to an MEC server. As shown in FIG. 7, the video resource transmission method includes:
在步骤S310中,接收VR主控端通过本公开所提供的上述推送方法所推送的视频资源;In step S310, receiving the video resource pushed by the VR master through the aforementioned pushing method provided by the present disclosure;
在步骤S320中,响应于所述用户终端拉取媒体流的请求,对所述视频资源进行渲染,获得VR视频资源;In step S320, in response to the request of the user terminal to pull the media stream, the video resource is rendered to obtain the VR video resource;
在步骤S330中,将所述VR视频资源传输给所述用户终端。In step S330, the VR video resource is transmitted to the user terminal.
需要解释的是,此处的“所述用户终端”为接入当前MEC服务器、且与所述VR主控端建立连接的用户终端。It should be explained that the "user terminal" here refers to a user terminal that accesses the current MEC server and establishes a connection with the VR master terminal.
本公开所提供的VR视频资源传输方法中,由MEC服务器对视频资源进行渲染并传输至用户终端,而不再通过主干网络进行传输,从而进一步降低了对网络带宽和计算资源的消耗。同时由于用户终端直接从MEC服务器获取视频资源,克服了现有技术中用户终端与云计算中心进行交互时需要经过多条链路、多个网元、多个网络造成的高时延、低可靠性的问题,确保了VR服务的质量。In the VR video resource transmission method provided by the present disclosure, the MEC server renders the video resource and transmits it to the user terminal instead of transmitting through the backbone network, thereby further reducing the consumption of network bandwidth and computing resources. At the same time, because the user terminal directly obtains video resources from the MEC server, it overcomes the high latency and low reliability caused by multiple links, multiple network elements, and multiple networks when the user terminal interacts with the cloud computing center in the prior art. Sexual issues ensure the quality of VR services.
在本公开中,对用户终端的FOV同步也是通过MEC服务器进行。相应地,所述视频资源传输方法除了包括上述步骤S310和步骤S320以外,如图8所示,在步骤S330之后,还包括:In the present disclosure, the FOV synchronization of the user terminal is also performed through the MEC server. Correspondingly, in addition to the above-mentioned step S310 and step S320, the video resource transmission method, as shown in FIG. 8, after step S330, further includes:
在步骤S340中,接收云计算中心服务器传输的FOV同步信息;In step S340, receive the FOV synchronization information transmitted by the cloud computing center server;
在步骤S350中,根据所述FOV同步信息同步所述用户终端的FOV。In step S350, the FOV of the user terminal is synchronized according to the FOV synchronization information.
作为本公开的第四个方面,提供一种视频资源推送模块100,所述视频资源推送模块100应用于云计算中心的虚拟现实VR主控端,如图9所示,所述视频资源推送模块100包括查询单元110和视频推送单元120。本方面所提供的视频资源推送模块100被设置为执行本公开第一个方面所提供的视频资源推送方法,具体地:As a fourth aspect of the present disclosure, a video resource pushing module 100 is provided. The video resource pushing module 100 is applied to the virtual reality VR master control terminal of a cloud computing center. As shown in FIG. 9, the video resource pushing module 100 includes a query unit 110 and a video push unit 120. The video resource pushing module 100 provided in this aspect is configured to execute the video resource pushing method provided in the first aspect of the present disclosure, specifically:
查询单元110被设置为执行步骤S110,即,查询单元110被设置为查询与当前VR主控端建立连接的用户终端接入的移动边缘计算MEC服务器;The query unit 110 is configured to perform step S110, that is, the query unit 110 is configured to query the mobile edge computing MEC server accessed by the user terminal that has established a connection with the current VR master control terminal;
视频推送单元120被设置为执行步骤S120,即,视频推送单元120被设置为向所述MEC服务器推送视频资源。The video pushing unit 120 is configured to perform step S120, that is, the video pushing unit 120 is configured to push video resources to the MEC server.
上文中已经对所述视频资源推送方法的原理以及有益效果进行了详细的描述,这里不再赘述。The principle and beneficial effects of the video resource pushing method have been described in detail above, and will not be repeated here.
作为本公开的第五个方面,提供一种FOV同步模块200,所述FOV同步模块200应用于云计算中心的云计算中心服务器,如图10,所述FOV同步模块200包括数据处理单元210和同步单元220。FOV同步模块被设置为执行本公开第二个方面所提供的FOV同步方法,具体地:As a fifth aspect of the present disclosure, a FOV synchronization module 200 is provided. The FOV synchronization module 200 is applied to a cloud computing center server of a cloud computing center. As shown in FIG. 10, the FOV synchronization module 200 includes a data processing unit 210 and Sync unit 220. The FOV synchronization module is set to execute the FOV synchronization method provided in the second aspect of the present disclosure, specifically:
数据处理单元210被设置为执行步骤S210,即,数据处理单元210被设置为接收VR主控端发送的FOV信息并生成FOV同步信息;The data processing unit 210 is configured to perform step S210, that is, the data processing unit 210 is configured to receive FOV information sent by the VR master control terminal and generate FOV synchronization information;
同步单元220被设置为执行步骤S220,即,同步单元220被设置为将所述FOV同步信息传输到与所述VR主控端建立连接的用户终端所接入的MEC服务器。The synchronization unit 220 is configured to perform step S220, that is, the synchronization unit 220 is configured to transmit the FOV synchronization information to the MEC server accessed by the user terminal that establishes a connection with the VR master control terminal.
上文中已经对所述FOV同步方法的工作原理以及有益效果进行了详细的描述,这里不 再赘述。The working principle and beneficial effects of the FOV synchronization method have been described in detail above, and will not be repeated here.
作为本公开的第六个方面,提供一种视频资源传输模块300,所述视频资源传输模块300应用于MEC服务器,如图11,所述视频资源传输模块300包括接收单元310、渲染传输单元320和传输单元330。As a sixth aspect of the present disclosure, a video resource transmission module 300 is provided. The video resource transmission module 300 is applied to an MEC server, as shown in FIG. 11. The video resource transmission module 300 includes a receiving unit 310 and a rendering transmission unit 320. And transmission unit 330.
接收单元310被设置为执行步骤S310,即,接收单元310被设置为接收VR主控端通过本公开所提供的第一方面所提供的视频资源推送方法所推送的视频资源;The receiving unit 310 is configured to perform step S310, that is, the receiving unit 310 is configured to receive the video resource pushed by the VR master through the video resource pushing method provided in the first aspect of the present disclosure;
渲染单元320被设置为执行步骤S320,即,渲染单元320被设置为响应于所述用户终端拉取媒体流的请求,对所述视频资源进行渲染;The rendering unit 320 is configured to perform step S320, that is, the rendering unit 320 is configured to render the video resource in response to a request of the user terminal to pull a media stream;
传输单元330被设置为执行步骤S330,即,传输单元330被设置为将渲染后的视频资源传输到所述用户终端。The transmission unit 330 is configured to perform step S330, that is, the transmission unit 330 is configured to transmit the rendered video resource to the user terminal.
上文中已经对所述VR视频资源传输方法的工作原理和有益效果进行了详细描述,这里不再赘述。The working principle and beneficial effects of the VR video resource transmission method have been described in detail above, and will not be repeated here.
作为本公开的第七个方面,提供一种VR主控端,所述VR主控端包括:As a seventh aspect of the present disclosure, a VR master control terminal is provided, and the VR master control terminal includes:
存储模块,所述存储模块上存储有应用程序;A storage module, the storage module stores an application program;
一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现本公开第一个方面所提供的视频资源推送方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the video resource pushing method provided in the first aspect of the present disclosure.
作为本公开的第八个方面,提供一种云计算中心服务器,所述云计算中心服务器包括:As an eighth aspect of the present disclosure, a cloud computing center server is provided, and the cloud computing center server includes:
存储模块,所述存储模块上存储有应用程序;A storage module, the storage module stores an application program;
一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现本公开第二个方面所提供的上述FOV同步方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the FOV synchronization method provided in the second aspect of the present disclosure.
作为本公开的第九个方面,提供一种MEC服务器,所述MEC服务器包括:As a ninth aspect of the present disclosure, an MEC server is provided, and the MEC server includes:
存储模块,所述存储模块上存储有应用程序;A storage module, the storage module stores an application program;
一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现本公开所提供的上述VR视频资源传输方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the aforementioned VR video resource transmission method provided by the present disclosure.
作为本公开的第十个方面,提供一种计算机可读存储介质,所述计算机可读存储介质上存储有可执行程序,所述可执行程序被执行时能够实现上述的视频资源推送方法、上述的FOV同步方法、和上述的VR视频资源传输方法中的任意一者。As a tenth aspect of the present disclosure, a computer-readable storage medium is provided, and an executable program is stored on the computer-readable storage medium. When the executable program is executed, the above-mentioned video resource pushing method and the above-mentioned Any one of the FOV synchronization method and the above-mentioned VR video resource transmission method.
其中,计算机可读存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机可读存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储介质、或者 可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。Among them, the computer-readable storage medium includes volatile and non-volatile, removable and The media cannot be removed. Computer-readable storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage media, Or any other medium that can be used to store desired information and that can be accessed by a computer.
在本公开中,对所述视频资源推送方法、所述FOV同步方法、所述VR视频资源传输方法的具体应用场景不做特殊的限定。如上文中所述,上述方法可以应用于VR视频会议中。下面结合VR视频会议的具体场景,对本公开所提供的所述视频资源推送方法、所述FOV同步方法、所述VR视频资源传输方法进行详细介绍。In this disclosure, the specific application scenarios of the video resource pushing method, the FOV synchronization method, and the VR video resource transmission method are not specifically limited. As mentioned above, the above method can be applied to VR video conferences. The following describes in detail the video resource pushing method, the FOV synchronization method, and the VR video resource transmission method provided by the present disclosure in conjunction with specific scenarios of the VR video conference.
所述VR视频会议的流程如下:The process of the VR video conference is as follows:
第一步,用户终端接入,包括以下步骤:The first step, user terminal access, includes the following steps:
用户终端(可以是平板电脑、台式电脑、VR设备、智能手机等)接入VR服务,注册到提供商的云计算中心;The user terminal (which can be a tablet computer, a desktop computer, a VR device, a smart phone, etc.) accesses the VR service and registers to the provider's cloud computing center;
云计算中心的VR主控端和用户终端建立连接;The VR master control terminal of the cloud computing center establishes a connection with the user terminal;
用户终端注册到MEC服务器。The user terminal is registered to the MEC server.
第二步,建立会议,包括以下步骤:The second step is to establish a meeting, including the following steps:
用户终端接入到VR服务提供上的云计算中心后,VR主控端创建VR多方会议;After the user terminal accesses the cloud computing center on the VR service provider, the VR master control terminal creates a VR multi-party conference;
用户终端查询当前VR主控端创建的会议列表;The user terminal queries the conference list created by the current VR master terminal;
用户终端选择需要加入的会议;The user terminal selects the conference to join;
用户终端选择加入会议后,云计算中心呼通用户终端,用户终端加入会议。After the user terminal chooses to join the conference, the cloud computing center calls the user terminal, and the user terminal joins the conference.
第三步,VR控制,包括以下步骤:The third step, VR control, includes the following steps:
VR主控端创建会议成功后,向资源服务器申请VR视频资源,获取到视频资源的相关信息后,向MEC服务器推送VR媒体流(即,所述视频资源);After successfully creating the meeting, the VR master control terminal applies for VR video resources from the resource server, and after obtaining relevant information of the video resources, pushes the VR media stream (that is, the video resources) to the MEC server;
用户终端向MEC服务器拉取VR视频资源;The user terminal pulls VR video resources from the MEC server;
MEC服务器对VR主控端推送的视频进行渲染后得到VR视频资源,并将该VR视频资源推送至用户终端。The MEC server renders the video pushed by the VR master control terminal to obtain the VR video resource, and pushes the VR video resource to the user terminal.
第四步,FOV同步,包括以下步骤:The fourth step, FOV synchronization, includes the following steps:
MEC服务器完成渲染后,VR主控端根据业务需要,切换视角展示或介绍业务;After the MEC server finishes rendering, the VR master control terminal will switch perspectives to display or introduce services according to business needs;
VR主控端将FOV信息发送至云计算中心服务器;The VR master control terminal sends the FOV information to the cloud computing center server;
云计算中心服务器向接入VR会议的所有用户终端发起FOV同步,具体地,通过通信层将FOV同步信息发送至各MEC服务器;The cloud computing center server initiates FOV synchronization to all user terminals that access the VR conference, specifically, sends the FOV synchronization information to each MEC server through the communication layer;
MEC服务器向终端发送渲染后的VR视频,并同步FOV;The MEC server sends the rendered VR video to the terminal and synchronizes the FOV;
最终,用户通过用户终端看到VR主控端的FOV,并开展业务。Finally, the user sees the FOV of the VR master control terminal through the user terminal and starts business.
可以理解的是,以上实施方式仅仅是为了说明本公开的原理而采用的示例性实施方式,然而本公开并不局限于此。对于本领域内的普通技术人员而言,在不脱离本公开的精神和 实质的情况下,可以做出各种变型和改进,这些变型和改进也视为本公开的保护范围。It can be understood that the above implementations are merely exemplary implementations used to illustrate the principle of the present disclosure, but the present disclosure is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and essence of the present disclosure, and these modifications and improvements are also deemed to be within the protection scope of the present disclosure.

Claims (14)

  1. 一种视频资源推送方法,所述视频资源推送方法应用于云计算中心的虚拟现实VR主控端,所述视频资源推送方法包括:A method for pushing video resources, the method for pushing video resources is applied to a virtual reality VR master control terminal of a cloud computing center, and the method for pushing video resources includes:
    查询与所述VR主控端建立连接的用户终端所接入的移动边缘计算MEC服务器;以及Query the mobile edge computing MEC server accessed by the user terminal that has established a connection with the VR master terminal; and
    向所述MEC服务器推送视频资源。Push video resources to the MEC server.
  2. 根据权利要求1所述的视频资源推送方法,其中,在向所述MEC服务器推送视频资源的步骤之前,所述视频资源推送方法还包括:The video resource pushing method according to claim 1, wherein, before the step of pushing the video resource to the MEC server, the video resource pushing method further comprises:
    检测所述MEC服务器上是否存在待推送至所述用户终端的视频资源;以及Detecting whether there are video resources to be pushed to the user terminal on the MEC server; and
    若所述MEC服务器上不存在所述待推送至所述用户终端的视频资源,执行向所述MEC服务器推送视频资源的步骤。If the video resource to be pushed to the user terminal does not exist on the MEC server, the step of pushing the video resource to the MEC server is performed.
  3. 根据权利要求2所述的视频资源推送方法,其中,检测所述MEC服务器上是否存在待推送至所述用户终端的视频资源的步骤包括:The video resource pushing method according to claim 2, wherein the step of detecting whether there is a video resource to be pushed to the user terminal on the MEC server comprises:
    检测所述MEC服务器上是否存在历史视频资源;Detecting whether there are historical video resources on the MEC server;
    若所述MEC服务器上存在所述历史视频资源,则检测该历史视频资源是否超时;以及If the historical video resource exists on the MEC server, detecting whether the historical video resource has timed out; and
    当满足以下条件中的任意一者时,判定所述MEC服务器上不存在所述待推送至所述用户终端的视频资源:When any one of the following conditions is met, it is determined that the video resource to be pushed to the user terminal does not exist on the MEC server:
    所述MEC服务器上不存在所述历史视频资源;以及The historical video resource does not exist on the MEC server; and
    所述MEC服务器上存在所述历史视频资源、且所述历史视频资源在所述MEC服务器上存储的时间超过预定时间。The historical video resource exists on the MEC server, and the storage time of the historical video resource on the MEC server exceeds a predetermined time.
  4. 根据权利要求1所述的视频资源推送方法,其中,在向所述MEC服务器推送视频资源的步骤之后,所述视频资源的推送方法还包括:The method for pushing video resources according to claim 1, wherein, after the step of pushing the video resources to the MEC server, the method for pushing video resources further comprises:
    将视角FOV信息发送到所述云计算中心的云计算中心服务器。The perspective FOV information is sent to the cloud computing center server of the cloud computing center.
  5. 一种FOV同步方法,所述FOV同步方法应用于云计算中心的云计算中心服务器,所述FOV同步方法包括:A FOV synchronization method, the FOV synchronization method is applied to a cloud computing center server of a cloud computing center, and the FOV synchronization method includes:
    接收VR主控端发送的FOV信息并生成FOV同步信息;以及Receive FOV information sent by the VR master control terminal and generate FOV synchronization information; and
    将所述FOV同步信息传输到与所述VR主控端建立连接的用户终端所接入的MEC服务器。The FOV synchronization information is transmitted to the MEC server accessed by the user terminal that has established a connection with the VR master control terminal.
  6. 一种VR视频资源传输方法,所述VR视频资源传输方法应用于MEC服务器,所述VR视频资源传输方法包括:A VR video resource transmission method, the VR video resource transmission method is applied to an MEC server, and the VR video resource transmission method includes:
    接收VR主控端通过权利要求1至4中任意一项所述的推送方法推送的视频资源;Receiving the video resource pushed by the VR master control terminal through the push method described in any one of claims 1 to 4;
    响应于所述用户终端拉取媒体流的请求,对所述视频资源进行渲染,以获得VR视频资源;以及In response to the request of the user terminal to pull the media stream, rendering the video resource to obtain the VR video resource; and
    将所述VR视频资源传输给所述用户终端。Transmitting the VR video resource to the user terminal.
  7. 根据权利要求6所述的VR视频资源传输方法,其中,在将所述VR视频资源传输给所述用户终端的步骤之后,所述视频资源传输方法还包括:The VR video resource transmission method according to claim 6, wherein, after the step of transmitting the VR video resource to the user terminal, the video resource transmission method further comprises:
    接收云计算中心服务器传输的FOV同步信息;以及Receive FOV synchronization information transmitted by the cloud computing center server; and
    根据所述FOV同步信息同步所述用户终端的FOV。Synchronize the FOV of the user terminal according to the FOV synchronization information.
  8. 一种视频资源推送模块,所述视频资源推送模块应用于云计算中心的虚拟现实VR主控端,所述视频资源推送模块包括:A video resource pushing module, the video resource pushing module is applied to the virtual reality VR main control terminal of a cloud computing center, and the video resource pushing module includes:
    查询单元,被设置为查询与当前VR主控端建立连接的用户终端所接入的移动边缘计算MEC服务器;以及The query unit is configured to query the mobile edge computing MEC server accessed by the user terminal that has established a connection with the current VR master terminal; and
    视频推送单元,被设置为向所述MEC服务器推送视频资源。The video pushing unit is configured to push video resources to the MEC server.
  9. 一种视角FOV同步模块,所述FOV同步模块应用于云计算中心的云计算中心服务器,所述FOV同步模块包括:A perspective FOV synchronization module, the FOV synchronization module is applied to a cloud computing center server of a cloud computing center, and the FOV synchronization module includes:
    数据处理单元,被设置为接收VR主控端发送的切换后的FOV并生成FOV同步信息;以及The data processing unit is configured to receive the switched FOV sent by the VR master control terminal and generate FOV synchronization information; and
    同步单元,被设置为将所述FOV同步信息传输到与所述VR主控端建立连接的用户终端接入的MEC服务器。The synchronization unit is configured to transmit the FOV synchronization information to the MEC server accessed by the user terminal that establishes a connection with the VR master control terminal.
  10. 一种视频资源传输模块,所述视频资源传输模块应用于MEC服务器,所述视频资源传输模块包括:A video resource transmission module, the video resource transmission module is applied to an MEC server, and the video resource transmission module includes:
    接收单元,被设置为接收VR主控端通过权利要求1至4中任意一项所述的视频资源推送方法所推送的视频资源;The receiving unit is configured to receive the video resource pushed by the VR master control terminal through the video resource pushing method according to any one of claims 1 to 4;
    渲染单元,被设置为响应于所述用户终端拉取媒体流的请求,对所述视频资源进行渲染,以获得VR视频资源;以及The rendering unit is configured to render the video resource in response to the request of the user terminal to pull the media stream to obtain the VR video resource; and
    传输单元,被设置为将所述VR视频资源传输到所述用户终端。The transmission unit is configured to transmit the VR video resource to the user terminal.
  11. 一种VR主控端,所述VR主控端包括:A VR master control terminal, the VR master control terminal includes:
    存储模块,所述存储模块上存储有应用程序;以及A storage module on which an application program is stored; and
    一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现权利要求1至4中任意一项所述的视频资源推送方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the video resource pushing method according to any one of claims 1 to 4 .
  12. 一种云计算中心服务器,所述云计算中心服务器包括:A cloud computing center server, the cloud computing center server includes:
    存储模块,所述存储模块上存储有应用程序;以及A storage module on which an application program is stored; and
    一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现权利要求5所述的FOV同步方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the FOV synchronization method according to claim 5.
  13. 一种MEC服务器,所述MEC服务器包括:An MEC server, the MEC server includes:
    存储模块,所述存储模块上存储有应用程序;以及A storage module on which an application program is stored; and
    一个或多个处理器,当所述应用程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现权利要求6或7所述的VR视频资源传输方法。One or more processors, when the application program is executed by the one or more processors, enable the one or more processors to implement the VR video resource transmission method according to claim 6 or 7.
  14. 一种计算机可读存储介质,所述计算机可读存储介质上存储有可执行程序,所述可执行程序被执行时能够实现以下方法中的一者:A computer-readable storage medium having an executable program stored on the computer-readable storage medium, and when the executable program is executed, one of the following methods can be implemented:
    权利要求1至4中任意一项所述的视频资源推送方法;The video resource pushing method according to any one of claims 1 to 4;
    权利要求5所述的FOV同步方法;以及The FOV synchronization method of claim 5; and
    权利要求6或7所述的视频资源传输方法。The video resource transmission method of claim 6 or 7.
PCT/CN2020/137800 2019-12-19 2020-12-18 Video pushing and transmission methods, angle of view synchronization method and apparatus, and storage medium WO2021121413A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911320510.6 2019-12-19
CN201911320510.6A CN113014961A (en) 2019-12-19 2019-12-19 Video pushing and transmitting method, visual angle synchronizing method and device and storage medium

Publications (1)

Publication Number Publication Date
WO2021121413A1 true WO2021121413A1 (en) 2021-06-24

Family

ID=76382364

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/137800 WO2021121413A1 (en) 2019-12-19 2020-12-18 Video pushing and transmission methods, angle of view synchronization method and apparatus, and storage medium

Country Status (2)

Country Link
CN (1) CN113014961A (en)
WO (1) WO2021121413A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115037958A (en) * 2022-03-22 2022-09-09 电子科技大学 Method for transmitting VR video through MEC cooperation based on 5G network

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108174421A (en) * 2018-03-05 2018-06-15 重庆邮电大学 A kind of data distribution method based on MEC auxiliary in 5G networks
US20180183860A1 (en) * 2016-12-23 2018-06-28 Kausik Majumdar Method and program product for robot communications
CN108337691A (en) * 2018-01-19 2018-07-27 南京邮电大学 A kind of services migrating method and system of mobile edge user oriented movement
CN110266664A (en) * 2019-06-05 2019-09-20 中国联合网络通信有限公司广州市分公司 A kind of Cloud VR video living transmission system based on 5G and MEC
CN110545307A (en) * 2019-07-19 2019-12-06 中移(杭州)信息技术有限公司 Edge computing platform, calling method and computer readable storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108521436B (en) * 2018-02-01 2020-11-17 上海交通大学 Mobile virtual reality transmission method and system based on terminal computing storage
CN108063773B (en) * 2018-02-11 2020-05-08 清华大学 Application service access method and device based on mobile edge computing
CN110166764B (en) * 2018-02-14 2022-03-01 阿里巴巴集团控股有限公司 Visual angle synchronization method and device in virtual reality VR live broadcast
CN109831659B (en) * 2018-11-29 2020-05-08 北京邮电大学 VR video caching method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180183860A1 (en) * 2016-12-23 2018-06-28 Kausik Majumdar Method and program product for robot communications
CN108337691A (en) * 2018-01-19 2018-07-27 南京邮电大学 A kind of services migrating method and system of mobile edge user oriented movement
CN108174421A (en) * 2018-03-05 2018-06-15 重庆邮电大学 A kind of data distribution method based on MEC auxiliary in 5G networks
CN110266664A (en) * 2019-06-05 2019-09-20 中国联合网络通信有限公司广州市分公司 A kind of Cloud VR video living transmission system based on 5G and MEC
CN110545307A (en) * 2019-07-19 2019-12-06 中移(杭州)信息技术有限公司 Edge computing platform, calling method and computer readable storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115037958A (en) * 2022-03-22 2022-09-09 电子科技大学 Method for transmitting VR video through MEC cooperation based on 5G network

Also Published As

Publication number Publication date
CN113014961A (en) 2021-06-22

Similar Documents

Publication Publication Date Title
US9686329B2 (en) Method and apparatus for displaying webcast rooms
US9686506B2 (en) Method, apparatus, system, and storage medium for video call and video call control
JP2020119497A (en) Live streaming segmentation method, apparatus and system
JP2014523568A (en) Efficient conditioning
WO2023138189A1 (en) Data processing method and apparatus, and device and medium
WO2014183427A1 (en) Method and apparatus for displaying webcast rooms
US20150319205A1 (en) Method for Transferring Media Stream and User Equipment
JP2024504092A (en) Mirroring methods, devices, electronic equipment and storage media
WO2016127796A1 (en) Information interaction method and server
WO2017071356A1 (en) Client-based network data synchronization method, apparatus and system
CN113608613B (en) Virtual reality interaction method and device, electronic equipment and computer readable medium
WO2021121413A1 (en) Video pushing and transmission methods, angle of view synchronization method and apparatus, and storage medium
CN114584808B (en) Video stream acquisition method, device, system, equipment and medium
US20220070507A1 (en) Method for distributing audio/video stream in audio/video stream distribution system, and dynamic parent node
US20210227005A1 (en) Multi-user instant messaging method, system, apparatus, and electronic device
WO2017030963A1 (en) Incorporating user content within a communication session interface
US11196842B2 (en) Collaborative and edge-enhanced augmented reality systems
WO2023197666A1 (en) Service scheduling method, system, vtep, storage medium, and computer program product
CN108668151B (en) Audio and video interaction method and device
CN113824689B (en) Edge computing network, data transmission method, device, equipment and storage medium
US10462248B2 (en) Digital content sharing cloud service system, digital content sharing cloud service device, and method using the same
CN114785848A (en) Collaborative interaction and collaboration method, device and system between electronic devices
CN115606170A (en) Multi-grouping for immersive teleconferencing and telepresence
WO2020063341A1 (en) Video transmission method and device
WO2024131383A1 (en) Data processing method and related apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20901501

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20901501

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 01/03/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20901501

Country of ref document: EP

Kind code of ref document: A1