CN108513096A - Information transferring method, proxy server, terminal device and content server - Google Patents

Information transferring method, proxy server, terminal device and content server Download PDF

Info

Publication number
CN108513096A
CN108513096A CN201710108777.3A CN201710108777A CN108513096A CN 108513096 A CN108513096 A CN 108513096A CN 201710108777 A CN201710108777 A CN 201710108777A CN 108513096 A CN108513096 A CN 108513096A
Authority
CN
China
Prior art keywords
view
content
proxy server
file
terminal device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710108777.3A
Other languages
Chinese (zh)
Other versions
CN108513096B (en
Inventor
陈亚迷
李刚
刘志明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Communication Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Communication Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201710108777.3A priority Critical patent/CN108513096B/en
Publication of CN108513096A publication Critical patent/CN108513096A/en
Application granted granted Critical
Publication of CN108513096B publication Critical patent/CN108513096B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10Architectures or entities
    • H04L65/1045Proxies, e.g. for session initiation protocol [SIP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a kind of information transferring method, proxy server, terminal device and content server, the method includes:At least one visual angle corresponding with the content requests that the terminal device is sent out and its corresponding visual angle file are got from the content server side of terminal device, at least one visual angle and its corresponding visual angle file are added to cache contents;Receive the visual angle file request information that the terminal device is sent;Based on the visual angle file request information, is chosen from the cache contents and obtain the aspect file corresponding to aspect, send the aspect file to the terminal device.

Description

信息传输方法、代理服务器、终端设备以及内容服务器Information transmission method, proxy server, terminal device, and content server

技术领域technical field

本发明涉及通信领域中的信息获取技术,尤其涉及一种信息传输方法、代理服务器、终端设备以及内容服务器。The invention relates to information acquisition technology in the field of communication, in particular to an information transmission method, a proxy server, terminal equipment and a content server.

背景技术Background technique

立体性(空间性)、交互性是AR/VR的一个重要特征。终端设备视角转移,将获得不同视角或者说对应视角的内容。以VR视频为例,当用户转动角度,用户将获得不同角度的视频文件。AR流程,当用户转动角度,内容服务器可能需要将真实的背景环境进行识别,基于传感器获得用户视角同背景环境同步,合成虚拟图像;并将同步的虚拟图像和真实环境进行合并渲染以及合成内容。或者AR内容服务器需要识别真实画面,相应地处理虚拟图像,使之能够“真实地”融合到现实画面中。Three-dimensional (spatial) and interactivity are important features of AR/VR. When the perspective of the terminal device is shifted, the content of different perspectives or corresponding perspectives will be obtained. Taking VR video as an example, when the user turns the angle, the user will get video files from different angles. In the AR process, when the user rotates the angle, the content server may need to recognize the real background environment, synchronize the user's perspective with the background environment based on the sensor, and synthesize a virtual image; and combine the synchronized virtual image and the real environment for rendering and composite content. Or the AR content server needs to recognize the real picture and process the virtual image accordingly so that it can be "truly" blended into the real picture.

基于视角的VR/AR内容提供,相比全视角内容提供的好处是可以减少这类业务造成的带宽消耗、降低业务对带宽需求,提升应用的普适性。但是,问题是一旦AR/VR的服务器端在相对远的距离,那么用户的视角传递,以及对应视角内容的反馈,都会发生延迟,一旦视角触发的内容不能及时获取,就会造成不好的用户感受。View-based VR/AR content provision, compared with full-view content provision, has the advantage of reducing bandwidth consumption caused by such services, reducing service bandwidth requirements, and improving application universality. However, the problem is that once the AR/VR server is at a relatively long distance, the transmission of the user's perspective and the feedback of the content corresponding to the perspective will be delayed. Once the content triggered by the perspective cannot be obtained in time, it will cause bad user experience. feel.

发明内容Contents of the invention

本发明的主要目的在于提出一种信息传输方法、代理服务器、终端设备以及内容服务器,旨在解决现有技术中存在的上述问题。The main purpose of the present invention is to propose an information transmission method, a proxy server, a terminal device and a content server, aiming at solving the above-mentioned problems existing in the prior art.

为实现上述目的,本发明提供一种信息传输方法,应用于代理服务器,包括:In order to achieve the above object, the present invention provides an information transmission method applied to a proxy server, including:

从终端设备的内容服务器侧获取到与所述终端设备发出的内容请求对应的至少一个视角及其所对应的视角文件,将所述至少一个视角及其对应的视角文件添加至缓存内容;Obtaining at least one view corresponding to the content request sent by the terminal device and its corresponding view file from the content server side of the terminal device, and adding the at least one view and its corresponding view file to the cache content;

接收到所述终端设备发来的视角文件请求信息;receiving the viewing angle file request information sent by the terminal device;

基于所述视角文件请求信息,从所述缓存内容中选取得到目标视角所对应的目标视角文件,发送所述目标视角文件至所述终端设备Based on the viewing angle file request information, select the target viewing angle file corresponding to the target viewing angle from the cache content, and send the target viewing angle file to the terminal device

本发明提供一种信息传输方法,应用于终端设备,所述方法包括:The present invention provides an information transmission method, which is applied to a terminal device, and the method includes:

向代理服务器发送视角文件请求信息;Send the perspective file request information to the proxy server;

接收到所述代理服务器基于所述视角文件请求信息从缓存内容中选取得到所述目标视角所对应的目标视角文件;Receiving that the proxy server selects from cache content based on the view file request information to obtain a target view file corresponding to the target view;

其中,所述缓存内容为所述代理服务器侧缓存的与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件。Wherein, the cache content is at least one view corresponding to the content request sent by the terminal device cached at the proxy server side, and a view file corresponding to each view.

本发明提供一种信息传输方法,应用于内容服务器,所述方法包括:The present invention provides an information transmission method, which is applied to a content server, and the method includes:

基于终端设备发出的内容请求,向终端设备的代理服务器发送与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件。Based on the content request sent by the terminal device, at least one view corresponding to the content request sent by the terminal device and a view file corresponding to each view are sent to the proxy server of the terminal device.

本发明提供一种代理服务器,包括:The present invention provides a proxy server, including:

缓存获取单元,用于从终端设备的内容服务器侧获取到与所述终端设备发出的内容请求对应的至少一个视角及其所对应的视角文件,将所述至少一个视角及其对应的视角文件添加至缓存内容;The cache acquiring unit is configured to acquire at least one view corresponding to the content request sent by the terminal device and its corresponding view file from the content server side of the terminal device, and add the at least one view and its corresponding view file to to cache content;

终端通信单元,用于接收到所述终端设备发来的视角文件请求信息;基于所述视角文件请求信息,从所述缓存内容中选取得到所述目标视角所对应的目标视角文件,发送所述目标视角文件至所述终端设备。The terminal communication unit is configured to receive the viewing angle file request information sent by the terminal device; based on the viewing angle file request information, select the target viewing angle file corresponding to the target viewing angle from the cache content, and send the The target view file is sent to the terminal device.

本发明提供一种终端设备,包括:The present invention provides a terminal device, including:

文件请求单元,用于向代理服务器发送视角文件请求信息;A file request unit, configured to send the viewing angle file request information to the proxy server;

文件获取单元,用于接收到所述代理服务器基于所述视角文件请求信息从缓存内容中选取得到所述目标视角所对应的目标视角文件;The file acquisition unit is configured to receive the proxy server to select the target view file corresponding to the target view from the cache content based on the view file request information;

其中,所述缓存内容为所述代理服务器侧缓存的与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件。Wherein, the cache content is at least one view corresponding to the content request sent by the terminal device cached at the proxy server side, and a view file corresponding to each view.

本发明提供一种内容服务器,包括:The present invention provides a content server, including:

缓存发送单元,用于基于终端设备发出的内容请求,向终端设备的代理服务器发送与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件。The cache sending unit is configured to send at least one view corresponding to the content request sent by the terminal device to the proxy server of the terminal device based on the content request sent by the terminal device, and a view file corresponding to each view.

本发明提出的一种信息传输方法、代理服务器、终端设备以及内容服务器,能够由代理服务器预先进行视角及其对应的视角文件的缓存,然后由代理服务器响应终端设备的视角文件请求信息为所述终端设备反馈目标视角对应的目标视角文件。如此,就能够快速响应用户业务的需求,减少终端设备获取视角文件的时延,避免用户使用终端设备的不适感。An information transmission method, a proxy server, a terminal device, and a content server proposed by the present invention can have the proxy server cache the viewing angle and its corresponding viewing angle file in advance, and then the proxy server can respond to the viewing angle file request information of the terminal device as the The terminal device feeds back the target view file corresponding to the target view. In this way, it is possible to quickly respond to the user's business needs, reduce the time delay for the terminal device to obtain the view file, and avoid the user's discomfort when using the terminal device.

附图说明Description of drawings

图1为本发明实施例信息传输方法流程示意图1;FIG. 1 is a schematic flow diagram 1 of an information transmission method according to an embodiment of the present invention;

图2为本发明实施例信息传输方法流程示意图2;FIG. 2 is a schematic flow diagram 2 of an information transmission method according to an embodiment of the present invention;

图3为本发明实施例信息传输方法流程示意图3;FIG. 3 is a schematic flow diagram 3 of an information transmission method according to an embodiment of the present invention;

图4为本发明实施例信息传输方法流程示意图4;FIG. 4 is a schematic flow diagram 4 of an information transmission method according to an embodiment of the present invention;

图5为本发明实施例信息传输方法流程示意图5;FIG. 5 is a schematic flow diagram 5 of an information transmission method according to an embodiment of the present invention;

图6为本发明实施例代理服务器组成结构示意图;FIG. 6 is a schematic diagram of the composition and structure of a proxy server according to an embodiment of the present invention;

图7为本发明实施例终端设备组成结构示意图;FIG. 7 is a schematic diagram of a composition structure of a terminal device according to an embodiment of the present invention;

图8为本发明实施例内容服务器组成结构示意图。FIG. 8 is a schematic diagram of the composition and structure of the content server according to the embodiment of the present invention.

具体实施方式Detailed ways

下面结合附图和具体实施例对本发明作进一步详细说明。The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

实施例一、Embodiment one,

本发明实施例提供了一种信息传输方法,应用于代理服务器,如图1所示,包括:An embodiment of the present invention provides an information transmission method, which is applied to a proxy server, as shown in Figure 1, including:

步骤101:从终端设备的内容服务器侧获取到与所述终端设备发出的内容请求对应的至少一个视角及其所对应的视角文件,将所述至少一个视角及其对应的视角文件添加至缓存内容;Step 101: Obtain at least one view corresponding to the content request sent by the terminal device and its corresponding view file from the content server side of the terminal device, and add the at least one view and its corresponding view file to the cache content ;

步骤102:接收到所述终端设备发来的视角文件请求信息;Step 102: Receive the viewing angle file request information sent by the terminal device;

步骤103:基于所述视角文件请求信息,从所述缓存内容中选取得到目标视角所对应的目标视角文件,发送所述目标视角文件至所述终端设备。Step 103: Based on the view file request information, select a target view file corresponding to the target view from the cached content, and send the target view file to the terminal device.

本实施例中,所述终端设备具体可以为能够运行VR/AR的终端设备,内容服务器也为能够提供VR/AR的内容服务器。In this embodiment, the terminal device may specifically be a terminal device capable of running VR/AR, and the content server may also be a content server capable of providing VR/AR.

在终端设备的用户视角发生变化之前,代理服务器跟远端的内容服务器交互,预先缓存对应的视角文件;缓存的视角及其对应的视角文件可以是终端设备的用户在初始接入系统时所在的当前视角附近的视角及其对应的视角文件;或者,可以为代理服务器根据掌握的用户视角行为习惯预测得到的用户常用的至少一个视角及其对应的视角文件;或者,还可以为所述代理服务器在所述终端设备的用户在当前视角以外的至少一个预设视角及其对应的视角文件;Before the user's perspective of the terminal device changes, the proxy server interacts with the remote content server to pre-cache the corresponding perspective file; the cached perspective and its corresponding perspective file can be the location where the user of the terminal device initially accesses the system. The angle of view near the current angle of view and its corresponding angle of view file; or, it may be at least one angle of view commonly used by the user and its corresponding angle of view file predicted by the proxy server according to the mastered user's angle of view behavior habits; or, it may also be the proxy server At least one preset viewing angle other than the current viewing angle of the user of the terminal device and its corresponding viewing angle file;

当终端设备的用户视角发生变化时,所述终端设备向代理服务器发来新的视角文件请求信息,代理服务器基于视角文件请求信息,从预先缓存的视角对应的视角文件分发用户。When the user's perspective of the terminal device changes, the terminal device sends a new perspective file request information to the proxy server, and the proxy server distributes the perspective file corresponding to the perspective cached in advance to the user based on the perspective file request information.

具体来说,所述从终端设备的内容服务器侧获取到缓存内容,包括:Specifically, the acquisition of cached content from the content server side of the terminal device includes:

从所述终端设备的内容服务器侧,获取到终端设备发出的内容请求对应的全部视角、以及每一个视角对应的视角文件;其中,所述内容请求中可以包括有至少一个维度的内容,比如,可以包括有终端设备的当前位置、当前视角等信息中的至少之一。可以理解的是,可以根据内容请求中的当前位置确定终端设备所要获取到的内容是什么,直接根据其对应的位置得知该位置处的全部视角以及每一个视角对应的视角文件。From the content server side of the terminal device, obtain all the views corresponding to the content request sent by the terminal device, and the view file corresponding to each view; wherein, the content request may include content with at least one dimension, for example, At least one of information such as a current location and a current viewing angle of the terminal device may be included. It can be understood that the content to be obtained by the terminal device can be determined according to the current location in the content request, and all the viewing angles at the location and the viewing angle files corresponding to each viewing angle can be obtained directly according to the corresponding location.

或者,or,

从所述终端设备的内容服务器侧,获取到终端设备的常用视角及其对应的视角文件;需要理解的是,这种处理方式建立在终端设备已有常用视角,或者代理服务器至少获取到终端设备的至少一次行为记录的基础上才能实现;基于终端设备的至少一次行为记录可以包括有终端设备通常会获取到N个请求获取的视角文件的视角为哪些,根据这样的分析得到终端设备的常用视角。From the content server side of the terminal device, the commonly used viewing angles of the terminal device and their corresponding viewing angle files are obtained; it should be understood that this processing method is based on the fact that the terminal device already has a commonly used viewing angle, or the proxy server at least obtains the terminal device It can only be realized on the basis of at least one behavior record of the terminal device; based on at least one behavior record of the terminal device, it can include the perspectives of the N requesting perspective files that the terminal device usually obtains, and according to such analysis, the common perspective of the terminal device can be obtained .

或者,or,

从所述终端设备的内容服务器侧,获取到终端设备当前视角对应的视角文件,并获取到所述当前视角的至少一个相关视角及其对应的视角文件;其中,所述相关视角表征与所述当前视角之间的角度差值小于预设门限值的视角。所述预设门限值可以根据实际情况进行设置,比如可以为左右30度之内,或者还可以包含上下30度之内。From the content server side of the terminal device, the viewing angle file corresponding to the current viewing angle of the terminal device is obtained, and at least one related viewing angle of the current viewing angle and its corresponding viewing angle file are obtained; wherein, the related viewing angle representation is the same as the The angle difference between the current angles of view is smaller than the preset threshold value. The preset threshold value can be set according to the actual situation, for example, it can be within 30 degrees left and right, or it can also be included within 30 degrees up and down.

需要说明的是,终端设备侧可以保存的内容为至少一个视角及其对应的链接信息;It should be noted that the content that can be stored on the terminal device side is at least one viewing angle and its corresponding link information;

当终端设备发起视角文件请求信息时,可以包括有一个具体的视角,也可以为根据所述视角首先确定其对应的连接信息,然后直接向代理服务器发送包含有视角(或视角文件)对应的链接信息作为所述视角文件请求信息;When a terminal device initiates a view file request message, it may include a specific view, or first determine its corresponding connection information according to the view, and then directly send a link containing the view (or view file) to the proxy server information as the view file request information;

相应的,业务服务器可以基于视角服务器中的视角,从自身缓存内容中选取得到目标视角文件;Correspondingly, the service server can select the target view file from its own cache content based on the view in the view server;

或者,所述业务服务器可以基于视角文件请求信息中的视角的链接信息,直接获取到对应的目标视角文件。Alternatively, the service server may directly acquire the corresponding target view file based on the view link information in the view file request information.

所述基于所述视角文件请求信息中的目标视角,从所述缓存内容中选取得到所述目标视角所对应的目标视角文件,发送所述目标视角文件至所述终端设备时,所述方法还包括:Based on the target viewing angle in the viewing angle file request information, selecting the target viewing angle file corresponding to the target viewing angle from the cache content, and sending the target viewing angle file to the terminal device, the method further include:

若所述代理服务器未保存有所述终端设备发出的内容请求对应的全部视角及其对应的文件,则从所述内容服务器获取到新的至少一个视角以及每一个新的视角所对应的视角文件;基于所述新的至少一个视角及其对应的视角文件更新的缓存内容。If the proxy server does not store all the angles and corresponding files corresponding to the content request sent by the terminal device, obtain at least one new angle and the angle file corresponding to each new angle from the content server ; Cache content updated based on the new at least one view and its corresponding view file.

或者or

若所述代理服务器未保存有所述终端设备发出的视角文件请求信息对应的全部视角文件,则从所述内容服务器获取到新的至少一个视角文件;基于所述新的至少一个视角文件更新的缓存内容。If the proxy server does not store all the viewing angle files corresponding to the viewing angle file request information sent by the terminal device, obtain at least one new viewing angle file from the content server; Cache content.

也就是说,在执行前述102-103步骤的同时,所述代理服务器还可以根据用户视角、或者基于缺失的视角文件,持续跟所述内容服务器进行交互以获取更新的缓存内容。That is to say, while performing the aforementioned steps 102-103, the proxy server may continue to interact with the content server to obtain updated cached content according to the user's perspective or based on a missing perspective file.

具体的,所述若所述代理服务器未保存有所述终端设备发出的内容请求对应的全部视角及其对应的文件,则从所述内容服务器获取到新的至少一个视角以及每一个新的视角所对应的视角文件,包括:Specifically, if the proxy server does not store all the views corresponding to the content request sent by the terminal device and their corresponding files, at least one new view and each new view may be obtained from the content server The corresponding perspective files include:

基于接收到的视角文件请求信息所对应的视角,对所述终端设备需要获取的至少一个视角进行预测,得到至少一个预测视角;Based on the angle of view corresponding to the received angle of view file request information, predict at least one angle of view to be acquired by the terminal device to obtain at least one predicted angle of view;

判断已有的缓存内容中是否保存有所述至少一个预测视角及其对应的视角文件;Judging whether the at least one predicted viewing angle and its corresponding viewing angle file are stored in the existing cache content;

若未保存,则基于所述至少一个预测视角从所述内容服务器侧获取到新的至少一个视角以及每一个新的视角所对应的视角文件。If not saved, at least one new viewing angle and a viewing angle file corresponding to each new viewing angle are acquired from the content server side based on the at least one predicted viewing angle.

进一步地,本实施例还可以应用到多维内容的传输处理中。通过在终端获取内容的过程中,基于预获取的终端行为数据或者预测的终端行为数据,提取终端下一步会用到的信息更多维度的内容,放到代理设备中进行存储。一旦终端需要,则将内容下发终端。Furthermore, this embodiment can also be applied to transmission processing of multi-dimensional content. In the process of acquiring content by the terminal, based on the pre-acquired terminal behavior data or predicted terminal behavior data, more dimensional content of information that the terminal will use in the next step is extracted and stored in the proxy device. Once the terminal needs it, the content will be delivered to the terminal.

其中,所述预测的方法,可以为如果代理服务器,记录了用户的历史行为;用户在过去请求中的优先选择内容维度1,轨迹是1->3->2,那么就能够比较容易确定预缓存的内容维度,比如当前用户看维度1,那么在用户做进一步请求之前,预缓存内容3;预测所得到的内容可能是预缓存内容3,或者预缓存内容3和2。可能取决于对用户读取内容的速度以及用户可用传输带宽的综合判断。Wherein, the prediction method can be as follows: if the proxy server records the user's historical behavior; the user's preferred content dimension 1 in the past request, the trajectory is 1->3->2, then it is relatively easy to determine the prediction Cache content dimension, for example, if the current user looks at dimension 1, then before the user makes further requests, pre-cache content 3; the predicted content may be pre-cache content 3, or pre-cache content 3 and 2. It may depend on the comprehensive judgment of the user's reading speed and the user's available transmission bandwidth.

进一步地,代理服务器从内容服务器中获取到内容请求所对应的全部视角及其视角文件,还是仅获取部分视角及其对应的视角文件的判定方法可以如下:至少基于所述终端设备的属性信息,确定从所述内容服务器获取的缓存内容中所包含的视角及其对应的视角文件的数量;Further, the method for determining whether the proxy server obtains all the views and view files corresponding to the content request from the content server, or only obtains part of the views and the corresponding view files may be as follows: at least based on the attribute information of the terminal device, determining the number of views contained in the cached content obtained from the content server and the number of corresponding view files;

其中,所述属性信息中包括以下信息至少之一:Wherein, the attribute information includes at least one of the following information:

所述终端设备中视角刷新速度;The viewing angle refresh rate in the terminal device;

所述终端设备的可用传输带宽;The available transmission bandwidth of the terminal device;

所述终端设备的最大传输带宽。The maximum transmission bandwidth of the terminal device.

其中,关于所述终端设备中视角刷新速度,可以为用户读取速度比如根据用户改变视角的速度来定,用户的可用传输带宽可以通过终端设备接入系统时获取到的终端设备的属性信息、或者网络属性确定。关于终端设备的属性信息可以为终端设备的最大接入带宽、网络属性可以为网络传输带宽等等;进一步来说,用户改变视角的速度越快,预缓存的视角文件可以越多,另外,终端设备对应的带宽越快预先缓存的视角文件也可以越多。Wherein, regarding the refreshing speed of the viewing angle in the terminal device, it can be determined by the user reading speed, for example, according to the speed at which the user changes the viewing angle, and the available transmission bandwidth of the user can be obtained through the attribute information of the terminal device obtained when the terminal device accesses the system, Or the network attribute is determined. The attribute information about the terminal device can be the maximum access bandwidth of the terminal device, the network attribute can be the network transmission bandwidth, etc.; further, the faster the user changes the viewing angle, the more viewing angle files can be pre-cached. In addition, the terminal The faster the corresponding bandwidth of the device, the more view files can be pre-cached.

基于前述的方案,如图2所示为其中一种实施流程,具体说明如下:Based on the aforementioned scheme, one of the implementation processes is shown in Figure 2, and the specific description is as follows:

1、终端设备向内容服务器发起内容请求;其中,所述内容请求可以包括有多个维度内容,比如可以包括以下至少之一:当前的角度信息,当前的位置信息等;或者,可以理解为向内容服务器发送的建立连接的请求信息;1. The terminal device initiates a content request to the content server; wherein, the content request may include multiple dimensions of content, for example, it may include at least one of the following: current angle information, current location information, etc.; or, it can be understood as requesting The request information sent by the content server to establish a connection;

2、内容服务器和代理服务器沟通同步不同视角文件在代理服务器侧的 url’信息以及之间的角度关系;2. The content server and the proxy server communicate and synchronize the url' information of different perspective files on the proxy server side and the angle relationship between them;

具体地,这个url’信息可以由内容服务器生成,并通知代理服务器进行配置,或者,可以由代理服务器生成,服务器向代理服务器发起请求并获得代理服务器侧对应业务的url’信息。其中,若由代理服务器生成并从内容服务器获取的话,可以通过内容服务器向代理服务器发送终端设备已经发起内容请求的通知后,代理服务器向内容服务器发送所要获取的URL信息的请求。Specifically, the url' information may be generated by the content server and notify the proxy server to configure, or may be generated by the proxy server, and the server initiates a request to the proxy server and obtains the url' information of the corresponding service on the proxy server side. Wherein, if generated by the proxy server and obtained from the content server, the proxy server may send a request for URL information to be obtained to the content server after the content server sends a notification that the terminal device has initiated a content request to the proxy server.

可能并行地,内容服务器面向代理服务器推送初始内容,特别地,如果内容服务器具有用户的视角行为信息,那么可根据其所掌握的信息,选择部分视角文件作为初始传输用;否则,如果内容服务器不具有用户的视角行为信息,内容服务器可能需要传输较全视角文件到代理服务器侧。或者,在带宽相对不充裕的情况下,推迟业务推送,即在收到用户视角请求信息之后,开始进行视角文件的推送,以及进行用户视角邻近视角的业务推送;Perhaps in parallel, the content server pushes the initial content to the proxy server. In particular, if the content server has the user’s perspective behavior information, it can select some perspective files for initial transmission according to the information it has; otherwise, if the content server does not With the viewing angle behavior information of the user, the content server may need to transmit a more comprehensive viewing angle file to the proxy server side. Or, when the bandwidth is relatively insufficient, the service push is postponed, that is, after receiving the request information of the user's perspective, the push of the perspective file is started, and the business push of the adjacent perspective of the user's perspective is carried out;

其中,所述配置代理服务器需要同内容服务器统一用户请求内容,在代理服务器侧的位置,代理服务器需要能够代替用户跟内容服务器请求内容,并作内容缓存;在用户真正做内容请求的时候,将内容分发用户,并进一步跟内容服务器要求用户请求或者下一步可能请求、但是尚未存储在代理服务器的内容;Wherein, the configuration of the proxy server needs to unify the content requested by the user with the content server. At the position of the proxy server, the proxy server needs to be able to replace the user to request content with the content server and cache the content; when the user actually makes a content request, the Content distribution users, and further ask the content server to request the content that the user requests or may request in the next step, but has not been stored in the proxy server;

配置的生成可以为:服务器可以告诉代理服务器,多维内容对应的维度以及各个维度内容文件位置,由代理服务器决策,多维内容各个维度内容文件在代理服务器对应的位置;The generation of configuration can be as follows: the server can tell the proxy server, the dimension corresponding to the multi-dimensional content and the location of the content file of each dimension are decided by the proxy server, and the content file of each dimension of the multi-dimensional content is in the corresponding position of the proxy server;

视角行为信息可以理解为,每一个视角获取周期,获取到的视角;比如1,视角轨迹1->3->2->…,以及视角轨迹变换的周期、时刻等。Viewpoint behavior information can be understood as each viewing angle acquisition cycle, the obtained viewing angle; for example, 1, viewing angle trajectory 1->3->2->..., and the cycle and time of viewing angle trajectory transformation.

需要说明的是,内容请求中并不一定携带视角,传统流程是在内容请求成功之后,开始请求视角;在正式的视角请求之前,基于前面所述的视角行为信息,先缓存部分内容。It should be noted that the content request does not necessarily carry the perspective. The traditional process is to start requesting the perspective after the content request is successful; before the formal perspective request, based on the above-mentioned perspective behavior information, first cache some content.

3、内容服务器面向终端设备返回代理服务器侧对应所有视角文件url’信息,以及之间的角度关系;3. The content server returns to the terminal device the url' information corresponding to all view files on the proxy server side, as well as the angle relationship between them;

4、终端设备基于收到的视角文件url’信息,选择起始url’,请求对应视角的内容文件;终端收到的是视角配置文件,比如什么样的视角对应什么样的url;基于这个信息,终端基于自己的视角,选择对应的url,进行请求4. Based on the received view file url' information, the terminal device selects the starting url' and requests the content file of the corresponding view; the terminal receives the view configuration file, such as what view corresponds to what url; based on this information , the terminal selects the corresponding url based on its own perspective, and makes a request

5、代理服务器返回终端设备所请求的视角文件url’信息;5. The proxy server returns the perspective file url' information requested by the terminal device;

6、终端设备随着用户转动头部,则根据新的角度确定新的视角文件url’信息,并发起内容请求;6. The terminal device determines the new perspective file url' information according to the new perspective as the user turns the head, and initiates a content request;

7、代理服务器根据终端设备更新的视角,返回新视角内容。7. The proxy server returns the content of the new viewing angle according to the updated viewing angle of the terminal device.

需要指出的是,在4-7步骤期间,内容服务器可能收到来自代理服务器反馈的终端的视角行为信息,比如终端视角请求信息,并基于获取的信息、或者没有获取信息,持续推送代理服务器侧的视角文件,直到内容传输完整(即包含全视角文件,或者基于用户行为判断包含所有用户需要的文件,或者包含用户当前视角附近一定范围的内容文件)。It should be pointed out that during steps 4-7, the content server may receive feedback from the proxy server on the viewing angle behavior information of the terminal, such as the terminal viewing angle request information, and based on the obtained information or not obtained information, continue to push the proxy server side View files until the content transmission is complete (that is, full view files are included, or all files needed by the user are included based on user behavior, or content files within a certain range near the user's current view angle are included).

前述流程中内容服务器和代理服务器建立相当的信任关系。内容服务器主动推送业务到代理服务器,由代理服务器支持进行内容分发的优化。该流程非常适用于内容服务商自建代理服务器,或者内容服务商和代理服务器建立稳固合同关系的场景。In the foregoing process, the content server and the proxy server establish a considerable trust relationship. The content server actively pushes services to the proxy server, and the proxy server supports optimization of content distribution. This process is very suitable for the scenario where the content service provider builds its own proxy server, or the content service provider and the proxy server establish a solid contract relationship.

备注:若对应内容文件信息已经完成存储在了代理服务器上,则图2示中的虚线交互不再需要。Note: If the corresponding content file information has been stored on the proxy server, the dotted line interaction shown in Figure 2 is no longer needed.

图3则为本实施例的另一种具体实施方式,与图2所示的方案不同之处在于,所述从终端设备的内容服务器侧获取到缓存内容之前,所述方法还包括:获取到所述终端设备向所述内容服务器发送的内容请求;基于所述内容请求,向所述内容服务器侧请求获取缓存内容。具体说明如下:Fig. 3 is another specific implementation of this embodiment, which is different from the solution shown in Fig. 2 in that before obtaining the cached content from the content server side of the terminal device, the method further includes: obtaining The content request sent by the terminal device to the content server; based on the content request, request the content server to acquire cached content. The specific instructions are as follows:

1、终端设备向内容服务器发起内容请求;1. The terminal device initiates a content request to the content server;

2、代理服务器识别或者截获终端设备的内容请求,并且由自身代为向内容服务器发起内容请求;2. The proxy server identifies or intercepts the content request of the terminal device, and initiates the content request to the content server by itself;

3、内容服务器向代理服务器反馈所有视角文件url及与对应视角角度的关系;3. The content server feeds back the urls of all view files and the relationship with the corresponding view angles to the proxy server;

与图2所示的流程的区别在于,上一个流程代理服务器和服务器是合作关系,代理服务器适合由内容服务器部署或者两者有协议关系;这个流程可能是一个中立的代理服务器。The difference from the process shown in Figure 2 is that the proxy server and the server in the previous process are in a cooperative relationship, and the proxy server is suitable for deployment by the content server or the two have an agreement relationship; this process may be a neutral proxy server.

4、代理服务器基于内容服务器反馈的信息,生成本地的视角文件url’以及与对应视角角度的关系,并将这个信息分发终端设备;4. Based on the information fed back by the content server, the proxy server generates the local viewing angle file url' and the relationship with the corresponding viewing angle, and distributes this information to the terminal device;

也就是说,将视角、视角文件对应的链接信息进行封装得到封装信息,发送所述封装信息至所述终端设备;That is to say, encapsulating the view and the link information corresponding to the view file to obtain encapsulation information, and sending the encapsulation information to the terminal device;

或者,or,

将视角、视角文件对应的链接信息进行封装得到封装信息,发送所述封装信息至所述内容服务器。Encapsulating the view and the link information corresponding to the view file to obtain encapsulation information, and sending the encapsulation information to the content server.

具体地,这个步骤的处理方式是,代理服务器以一定的方式封装数据包,直接反馈用户;或者,这个步骤进一步区分成为两步,首先,由代理服务器将确定好的代理侧url’以及与对应角度的关系反馈给服务器,然后,由代理服务器反馈终端设备;Specifically, the processing method of this step is that the proxy server encapsulates the data packet in a certain way and directly feeds back to the user; or, this step is further divided into two steps. First, the proxy server will determine the proxy side url' and the corresponding The angle relationship is fed back to the server, and then the proxy server feeds back to the terminal device;

5、终端设备基于代理服务器反馈的信息,选择起始url’,发起内容请求;5. Based on the information fed back by the proxy server, the terminal device selects the starting url' and initiates a content request;

6、代理服务器返回终端设备所请求的视角内容;6. The proxy server returns the viewing angle content requested by the terminal device;

在执行步骤4-6间,代理服务器向内容服务器请求的初始内容(也就是内容请求所对应的当前视角、或当前位置所对应的内容),特别地,如果代理服务器具有用户的视角行为信息,那么可根据其所掌握的信息,选择部分视角文件作为初始传输用。否则,代理服务器可能需要请求传输较全视角文件到代理服务器侧。或者,在带宽相对不充裕的情况下,推迟业务请求,即在收到用户视角请求信息之后,开始进行视角文件的请求,以及进行用户视角邻近视角的业务请求;这个过程持续到用户结束这个业务,或者直到代理服务器获得完整内容(即包含全视角文件,或者基于用户行为判断包含所有用户需要的文件,或者包含用户当前视角附近一定范围的内容文件)。During steps 4-6, the proxy server requests the content server for the initial content (that is, the content corresponding to the current viewing angle corresponding to the content request, or the content corresponding to the current location), especially if the proxy server has the user's viewing angle behavior information, Then, according to the information it possesses, some view files can be selected for initial transmission. Otherwise, the proxy server may need to request to transmit the full-view file to the proxy server side. Or, in the case of relatively insufficient bandwidth, the service request is postponed, that is, after receiving the user's view request information, the request for the view file and the service request for the adjacent view of the user's view are started; this process continues until the user ends the service , or until the proxy server obtains the complete content (that is, contains the full-view file, or contains all the files needed by the user based on user behavior judgment, or contains a certain range of content files near the user's current view).

7、终端设备转动头部,则根据新的角度确定新的视角文件url’信息,并发起内容请求;7. When the terminal device turns its head, it determines the new perspective file url' information according to the new perspective, and initiates a content request;

8、代理服务器根据终端设备更新的视角,返回新视角内容。8. The proxy server returns the content of the new viewing angle according to the updated viewing angle of the terminal device.

图3提供的处理方式中,所涉及的流程适用于代理服务器和终端设备建立了一定的信任关系,能够获得终端设备的请求内容,具体地,由终端设备主动通过代理服务器能够识别的语言透露给代理服务器,或者代理服务器具有解析用户这类请求的能力。该流程非常适用于由网络运营商来提供代理服务器的场景。In the processing method provided in Figure 3, the process involved is applicable to the fact that the proxy server and the terminal device have established a certain trust relationship and can obtain the request content of the terminal device. Specifically, the terminal device actively discloses the content of the request to the A proxy server, or a proxy server has the ability to resolve such requests from users. This process is very applicable to the scenario where the network operator provides the proxy server.

进一步地,若代理服务器,由网络运营商来部署的时候,代理服务器具备较为充分的网络信息。那么代理服务器可以根据不同时间节点网络的负载忙闲状况差异,选择多缓存或者少缓存用户的内容。比如,在初始内容申请时,如果网络状态相对空闲的时候,代理服务器可以一次性帮用户申请更多的内容,并把用户暂时不需要的内容进行缓存。Further, if the proxy server is deployed by the network operator, the proxy server has sufficient network information. Then the proxy server can choose to cache more or less user content according to the difference in the load status of the node network at different times. For example, during the initial content application, if the network status is relatively idle, the proxy server can help the user apply for more content at one time, and cache the content that the user does not need temporarily.

备注:若对应内容文件信息已经完成存储在了代理服务器上,则图3示中的虚线交互不再需要。Note: If the corresponding content file information has been stored on the proxy server, the dotted line interaction shown in Figure 3 is no longer needed.

图4则为再一种处理流程,与图2和图3的不同之处在于,所述从终端设备的内容服务器侧获取到缓存内容之前,所述方法还包括:与所述终端设备进行协商,得到交互信令的格式;接收到所述终端设备基于所述交互信令的格式发来的内容请求;基于所述内容请求,向所述内容服务器侧请求获取缓存内容;其中,协商的过程,包括通过网络的标准化,允许用户发送网络可识别的信令,告知网络面向网络部署的代理服务器,进行对应内容请求;Fig. 4 is yet another processing flow, which is different from Fig. 2 and Fig. 3 in that, before obtaining the cached content from the content server side of the terminal device, the method further includes: negotiating with the terminal device , obtain the format of the interactive signaling; receive the content request sent by the terminal device based on the format of the interactive signaling; based on the content request, request the content server side to obtain cached content; wherein, the process of negotiation , including through the standardization of the network, allowing users to send network-recognizable signaling to inform the network-oriented proxy server deployed on the network to make corresponding content requests;

另外,步骤1中,协商得到的请求内容包括:基于所述的信令格式,也就是填充对应的信息,比如内容url,通过信令封装,传递给代理服务器。In addition, in step 1, the negotiated request content includes: based on the signaling format, that is, fill in the corresponding information, such as the content url, encapsulate it through signaling, and transmit it to the proxy server.

所述提案适用于所有涉及的角度交互或者类似角度交互的内容分发的,内容优化。The proposal is applicable to all content distribution and content optimization involving angle interaction or similar angle interaction.

图4的剩余步骤的处理方式与图3相同,这里不再进行赘述。The processing manner of the remaining steps in FIG. 4 is the same as that in FIG. 3 , and will not be repeated here.

可见,通过采用本实施例提供的方案,就能够由代理服务器预先进行视角及其对应的视角文件的缓存,然后由代理服务器响应终端设备的视角文件请求信息为所述终端设备反馈目标视角对应的目标视角文件。如此,就能够快速响应用户业务的需求,减少终端设备获取视角文件的时延,避免用户使用终端设备的不适感。It can be seen that by adopting the solution provided in this embodiment, the proxy server can pre-cache the view angle and the corresponding view file, and then the proxy server can respond to the view file request information of the terminal device to feed back the corresponding view file of the target view to the terminal device. Target view file. In this way, it is possible to quickly respond to the user's business needs, reduce the time delay for the terminal device to obtain the view file, and avoid the user's discomfort when using the terminal device.

实施例二、Embodiment two,

本实施例提供了一种信息传输方法,应用于终端设备,如图5所示,所述方法包括:This embodiment provides an information transmission method, which is applied to a terminal device. As shown in FIG. 5, the method includes:

步骤501:向代理服务器发送视角文件请求信息;Step 501: Sending viewing angle file request information to the proxy server;

步骤502:接收到所述代理服务器基于所述视角文件请求信息从缓存内容中选取得到所述目标视角所对应的目标视角文件;Step 502: receiving that the proxy server selects the target view file corresponding to the target view from the cache content based on the view file request information;

其中,所述缓存内容为所述代理服务器侧缓存的与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件。Wherein, the cache content is at least one view corresponding to the content request sent by the terminal device cached at the proxy server side, and a view file corresponding to each view.

本实施例中,所述终端设备具体可以为能够运行VR/AR的终端设备,内容服务器也为能够提供VR/AR的内容服务器。In this embodiment, the terminal device may specifically be a terminal device capable of running VR/AR, and the content server may also be a content server capable of providing VR/AR.

在终端设备的用户视角发生变化之前,代理服务器跟远端的内容服务器交互,预先缓存对应的视角文件;缓存的视角及其对应的视角文件可以是终端设备的用户在初始接入系统时所在的当前视角附近的视角及其对应的视角文件;或者,可以为代理服务器根据掌握的用户视角行为习惯预测得到的用户常用的至少一个视角及其对应的视角文件;或者,还可以为所述代理服务器在所述终端设备的用户在当前视角以外的至少一个预设视角及其对应的视角文件;Before the user's perspective of the terminal device changes, the proxy server interacts with the remote content server to pre-cache the corresponding perspective file; the cached perspective and its corresponding perspective file can be the location where the user of the terminal device initially accesses the system. The angle of view near the current angle of view and its corresponding angle of view file; or, it may be at least one angle of view commonly used by the user and its corresponding angle of view file predicted by the proxy server according to the mastered user's angle of view behavior habits; or, it may also be the proxy server At least one preset viewing angle other than the current viewing angle of the user of the terminal device and its corresponding viewing angle file;

当终端设备的用户视角发生变化时,所述终端设备向代理服务器发来新的视角文件请求信息,代理服务器基于视角文件请求信息,从预先缓存的视角对应的视角文件分发用户。When the user's perspective of the terminal device changes, the terminal device sends a new perspective file request information to the proxy server, and the proxy server distributes the perspective file corresponding to the perspective cached in advance to the user based on the perspective file request information.

具体来说,所述从终端设备的内容服务器侧获取到缓存内容,包括:Specifically, the acquisition of cached content from the content server side of the terminal device includes:

从所述终端设备的内容服务器侧,获取到终端设备发出的内容请求对应的全部视角、以及每一个视角对应的视角文件;其中,所述内容请求中可以包括有至少一个维度的内容,比如,可以包括有终端设备的当前位置、当前视角等信息中的至少之一。可以理解的是,可以根据内容请求中的当前位置确定终端设备所要获取到的内容是什么,直接根据其对应的位置得知该位置处的全部视角以及每一个视角对应的视角文件。From the content server side of the terminal device, obtain all the views corresponding to the content request sent by the terminal device, and the view file corresponding to each view; wherein, the content request may include content with at least one dimension, for example, At least one of information such as a current location and a current viewing angle of the terminal device may be included. It can be understood that the content to be obtained by the terminal device can be determined according to the current location in the content request, and all the viewing angles at the location and the viewing angle files corresponding to each viewing angle can be obtained directly according to the corresponding location.

或者,or,

从所述终端设备的内容服务器侧,获取到终端设备的常用视角及其对应的视角文件;需要理解的是,这种处理方式建立在终端设备已有常用视角,或者代理服务器至少获取到终端设备的至少一次行为记录的基础上才能实现;基于终端设备的至少一次行为记录可以包括有终端设备通常会获取到N个请求获取的视角文件的视角为哪些,根据这样的分析得到终端设备的常用视角。From the content server side of the terminal device, the commonly used viewing angles of the terminal device and their corresponding viewing angle files are obtained; it should be understood that this processing method is based on the fact that the terminal device already has a commonly used viewing angle, or the proxy server at least obtains the terminal device It can only be realized on the basis of at least one behavior record of the terminal device; based on at least one behavior record of the terminal device, it can include the perspectives of the N requesting perspective files that the terminal device usually obtains, and according to such analysis, the common perspective of the terminal device is obtained .

或者,or,

从所述终端设备的内容服务器侧,获取到终端设备当前视角对应的视角文件,并获取到所述当前视角的至少一个相关视角及其对应的视角文件;其中,所述相关视角表征与所述当前视角之间的角度差值小于预设门限值的视角。所述预设门限值可以根据实际情况进行设置,比如可以为左右30度之内,或者还可以包含上下30度之内。From the content server side of the terminal device, the viewing angle file corresponding to the current viewing angle of the terminal device is obtained, and at least one related viewing angle of the current viewing angle and its corresponding viewing angle file are obtained; wherein, the related viewing angle representation is the same as the The angle difference between the current angles of view is smaller than the preset threshold value. The preset threshold value can be set according to the actual situation, for example, it can be within 30 degrees left and right, or it can also be included within 30 degrees up and down.

需要说明的是,终端设备侧可以保存的内容为至少一个视角及其对应的链接信息;It should be noted that the content that can be stored on the terminal device side is at least one viewing angle and its corresponding link information;

当终端设备发起视角文件请求信息时,可以包括有一个具体的视角,也可以为根据所述视角首先确定其对应的连接信息,然后直接向代理服务器发送包含有视角(或视角文件)对应的链接信息作为所述视角文件请求信息;When a terminal device initiates a view file request message, it may include a specific view, or first determine its corresponding connection information according to the view, and then directly send a link containing the view (or view file) to the proxy server information as the view file request information;

相应的,业务服务器可以基于视角服务器中的视角,从自身缓存内容中选取得到目标视角文件;Correspondingly, the service server can select the target view file from its own cache content based on the view in the view server;

或者,所述业务服务器可以基于视角文件请求信息中的视角的链接信息,直接获取到对应的目标视角文件。Alternatively, the service server may directly acquire the corresponding target view file based on the view link information in the view file request information.

所述基于所述视角文件请求信息中的目标视角,从所述缓存内容中选取得到所述目标视角所对应的目标视角文件,发送所述目标视角文件至所述终端设备时,所述方法还包括:Based on the target viewing angle in the viewing angle file request information, selecting the target viewing angle file corresponding to the target viewing angle from the cache content, and sending the target viewing angle file to the terminal device, the method further include:

若所述代理服务器未保存有所述终端设备发出的内容请求对应的全部视角及其对应的文件,则从所述内容服务器获取到新的至少一个视角以及每一个新的视角所对应的视角文件;If the proxy server does not store all the angles and corresponding files corresponding to the content request sent by the terminal device, obtain at least one new angle and the angle file corresponding to each new angle from the content server ;

基于所述新的至少一个视角及其对应的视角文件更新的缓存内容。The updated cache content based on the at least one new view angle and its corresponding view file.

也就是说,在执行前述102-103步骤的同时,所述代理服务器还可以根据用户视角、或者基于缺失的视角文件,持续跟所述内容服务器进行交互以获取更新的缓存内容。That is to say, while performing the aforementioned steps 102-103, the proxy server may continue to interact with the content server to obtain updated cached content according to the user's perspective or based on a missing perspective file.

具体的,所述若所述代理服务器未保存有所述终端设备发出的内容请求对应的全部视角及其对应的文件,则从所述内容服务器获取到新的至少一个视角以及每一个新的视角所对应的视角文件,包括:Specifically, if the proxy server does not store all the views corresponding to the content request sent by the terminal device and their corresponding files, at least one new view and each new view may be obtained from the content server The corresponding perspective files include:

基于接收到的视角文件请求信息所对应的视角,对所述终端设备需要获取的至少一个视角进行预测,得到至少一个预测视角;Based on the angle of view corresponding to the received angle of view file request information, predict at least one angle of view to be acquired by the terminal device to obtain at least one predicted angle of view;

判断已有的缓存内容中是否保存有所述至少一个预测视角及其对应的视角文件;Judging whether the at least one predicted viewing angle and its corresponding viewing angle file are stored in the existing cache content;

若未保存,则基于所述至少一个预测视角从所述内容服务器侧获取到新的至少一个视角以及每一个新的视角所对应的视角文件。If not saved, at least one new viewing angle and a viewing angle file corresponding to each new viewing angle are acquired from the content server side based on the at least one predicted viewing angle.

进一步地,本实施例还可以应用到多维内容的传输处理中。通过在终端获取内容的过程中,基于预获取的终端行为数据或者预测的终端行为数据,提取终端下一步会用到的信息更多维度的内容,放到代理设备中进行存储。一旦终端需要,则将内容下发终端。Furthermore, this embodiment can also be applied to transmission processing of multi-dimensional content. In the process of acquiring content by the terminal, based on the pre-acquired terminal behavior data or predicted terminal behavior data, more dimensional content of information that the terminal will use in the next step is extracted and stored in the proxy device. Once the terminal needs it, the content will be delivered to the terminal.

其中,所述预测的方法,可以为如果代理服务器,记录了用户的历史行为;用户在过去请求中的优先选择内容维度1,轨迹是1->3->2,那么就能够比较容易确定预缓存的内容维度,比如当前用户看维度1,那么在用户做进一步请求之前,预缓存内容3;预测所得到的内容可能是预缓存内容3,或者预缓存内容3和2。可能取决于对用户读取内容的速度以及用户可用传输带宽的综合判断。Wherein, the prediction method can be as follows: if the proxy server records the user's historical behavior; the user's preferred content dimension 1 in the past request, the trajectory is 1->3->2, then it is relatively easy to determine the prediction Cache content dimension, for example, if the current user looks at dimension 1, then before the user makes further requests, pre-cache content 3; the predicted content may be pre-cache content 3, or pre-cache content 3 and 2. It may depend on the comprehensive judgment of the user's reading speed and the user's available transmission bandwidth.

进一步地,代理服务器从内容服务器中获取到内容请求所对应的全部视角及其视角文件,还是仅获取部分视角及其对应的视角文件的判定方法可以如下:至少基于所述终端设备的属性信息,确定从所述内容服务器获取的缓存内容中所包含的视角及其对应的视角文件的数量;Further, the method for determining whether the proxy server obtains all the views and view files corresponding to the content request from the content server, or only obtains part of the views and the corresponding view files may be as follows: at least based on the attribute information of the terminal device, determining the number of views contained in the cached content obtained from the content server and the number of corresponding view files;

其中,所述属性信息中包括以下信息至少之一:Wherein, the attribute information includes at least one of the following information:

所述终端设备中视角刷新速度;The viewing angle refresh rate in the terminal device;

所述终端设备的可用传输带宽;The available transmission bandwidth of the terminal device;

所述终端设备的最大传输带宽。The maximum transmission bandwidth of the terminal device.

其中,关于所述终端设备中视角刷新速度,可以为用户读取速度比如根据用户改变视角的速度来定,用户的可用传输带宽可以通过终端设备接入系统时获取到的终端设备的属性信息、或者网络属性确定。关于终端设备的属性信息可以为终端设备的最大接入带宽、网络属性可以为网络传输带宽等等;进一步来说,用户改变视角的速度越快,预缓存的视角文件可以越多,另外,终端设备对应的带宽越快预先缓存的视角文件也可以越多。Wherein, regarding the refreshing speed of the viewing angle in the terminal device, it can be determined by the user reading speed, for example, according to the speed at which the user changes the viewing angle, and the available transmission bandwidth of the user can be obtained through the attribute information of the terminal device obtained when the terminal device accesses the system, Or the network attribute is determined. The attribute information about the terminal device can be the maximum access bandwidth of the terminal device, the network attribute can be the network transmission bandwidth, etc.; further, the faster the user changes the viewing angle, the more viewing angle files can be pre-cached. In addition, the terminal The faster the corresponding bandwidth of the device, the more view files can be pre-cached.

基于前述的方案,所述向代理服务器发送视角文件请求信息之前,所述方法还包括:向内容服务器发送内容请求;接收到所述内容服务器反馈的在所述代理服务器侧缓存的至少一个视角,或者,接收到所述内容服务器反馈的在所述代理服务器侧缓存的至少一个视角及其链接信息。如图2所示为其中一种实施流程,具体说明如下:Based on the foregoing solution, before sending the viewing angle file request information to the proxy server, the method further includes: sending a content request to the content server; receiving at least one viewing angle cached on the proxy server side fed back by the content server, Or, receiving at least one viewing angle and its link information fed back by the content server and cached on the proxy server side. Figure 2 shows one of the implementation processes, and the details are as follows:

1、终端设备向内容服务器发起内容请求;其中,所述内容请求可以包括有多个维度内容,比如可以包括以下至少之一:当前的角度信息,当前的位置信息等;或者,可以理解为向内容服务器发送的建立连接的请求信息;1. The terminal device initiates a content request to the content server; wherein, the content request may include multiple dimensions of content, for example, it may include at least one of the following: current angle information, current location information, etc.; or, it can be understood as requesting The request information sent by the content server to establish a connection;

2、内容服务器和代理服务器沟通同步不同视角文件在代理服务器侧的url’信息以及之间的角度关系;2. The content server and the proxy server communicate and synchronize the url' information of different perspective files on the proxy server side and the angle relationship between them;

具体地,这个url’信息可以由内容服务器生成,并通知代理服务器进行配置,或者,可以由代理服务器生成,服务器向代理服务器发起请求并获得代理服务器侧对应业务的url’信息。其中,若由代理服务器生成并从内容服务器获取的话,可以通过内容服务器向代理服务器发送终端设备已经发起内容请求的通知后,代理服务器向内容服务器发送所要获取的URL信息的请求。Specifically, the url' information may be generated by the content server and notify the proxy server to configure, or may be generated by the proxy server, and the server initiates a request to the proxy server and obtains the url' information of the corresponding service on the proxy server side. Wherein, if generated by the proxy server and obtained from the content server, the proxy server may send a request for URL information to be obtained to the content server after the content server sends a notification that the terminal device has initiated a content request to the proxy server.

可能并行地,内容服务器面向代理服务器推送初始内容,特别地,如果内容服务器具有用户的视角行为信息,那么可根据其所掌握的信息,选择部分视角文件作为初始传输用;否则,如果内容服务器不具有用户的视角行为信息,内容服务器可能需要传输较全视角文件到代理服务器侧。或者,在带宽相对不充裕的情况下,推迟业务推送,即在收到用户视角请求信息之后,开始进行视角文件的推送,以及进行用户视角邻近视角的业务推送;Perhaps in parallel, the content server pushes the initial content to the proxy server. In particular, if the content server has the user’s perspective behavior information, it can select some perspective files for initial transmission according to the information it has; otherwise, if the content server does not With the viewing angle behavior information of the user, the content server may need to transmit a more comprehensive viewing angle file to the proxy server side. Or, when the bandwidth is relatively insufficient, the service push is postponed, that is, after receiving the request information of the user's perspective, the push of the perspective file is started, and the business push of the adjacent perspective of the user's perspective is carried out;

其中,所述配置代理服务器需要同内容服务器统一用户请求内容,在代理服务器侧的位置,代理服务器需要能够代替用户跟内容服务器请求内容,并作内容缓存;在用户真正做内容请求的时候,将内容分发用户,并进一步跟内容服务器要求用户请求或者下一步可能请求、但是尚未存储在代理服务器的内容;Wherein, the configuration of the proxy server needs to unify the content requested by the user with the content server. At the position of the proxy server, the proxy server needs to be able to replace the user to request content with the content server and cache the content; when the user actually makes a content request, the Content distribution users, and further ask the content server to request the content that the user requests or may request in the next step, but has not been stored in the proxy server;

配置的生成可以为:服务器可以告诉代理服务器,多维内容对应的维度以及各个维度内容文件位置,由代理服务器决策,多维内容各个维度内容文件在代理服务器对应的位置;The generation of configuration can be as follows: the server can tell the proxy server, the dimension corresponding to the multi-dimensional content and the location of the content file of each dimension are decided by the proxy server, and the content file of each dimension of the multi-dimensional content is in the corresponding position of the proxy server;

视角行为信息可以理解为,每一个视角获取周期,获取到的视角;比如1,视角轨迹1->3->2->…,以及视角轨迹变换的周期、时刻等。Viewpoint behavior information can be understood as each viewing angle acquisition cycle, the obtained viewing angle; for example, 1, viewing angle trajectory 1->3->2->..., and the cycle and time of viewing angle trajectory transformation.

需要说明的是,内容请求中并不一定携带视角,传统流程是在内容请求成功之后,开始请求视角;在正式的视角请求之前,基于前面所述的视角行为信息,先缓存部分内容。It should be noted that the content request does not necessarily carry the perspective. The traditional process is to start requesting the perspective after the content request is successful; before the formal perspective request, based on the above-mentioned perspective behavior information, first cache some content.

3、内容服务器面向终端设备返回代理服务器侧对应所有视角文件url’信息,以及之间的角度关系;3. The content server returns to the terminal device the url' information corresponding to all view files on the proxy server side, as well as the angle relationship between them;

4、终端设备基于收到的视角文件url’信息,选择起始url’,请求对应视角的内容文件;终端收到的是视角配置文件,比如什么样的视角对应什么样的url;基于这个信息,终端基于自己的视角,选择对应的url,进行请求4. Based on the received view file url' information, the terminal device selects the starting url' and requests the content file of the corresponding view; the terminal receives the view configuration file, such as what view corresponds to what url; based on this information , the terminal selects the corresponding url based on its own perspective, and makes a request

5、代理服务器返回终端设备所请求的视角文件url’信息;5. The proxy server returns the perspective file url' information requested by the terminal device;

6、终端设备随着用户转动头部,则根据新的角度确定新的视角文件url’信息,并发起内容请求;6. The terminal device determines the new perspective file url' information according to the new perspective as the user turns the head, and initiates a content request;

7、代理服务器根据终端设备更新的视角,返回新视角内容。7. The proxy server returns the content of the new viewing angle according to the updated viewing angle of the terminal device.

需要指出的是,在4步骤-7期间,内容服务器可能收到来自代理服务器反馈的终端的视角行为信息,比如终端视角请求信息,并基于获取的信息、或者没有获取信息,持续推送代理服务器侧的视角文件,直到内容传输完整 (即包含全视角文件,或者基于用户行为判断包含所有用户需要的文件,或者包含用户当前视角附近一定范围的内容文件)。It should be pointed out that during Step 4-7, the content server may receive the viewing angle behavior information of the terminal fed back from the proxy server, such as the terminal viewing angle request information, and based on the obtained information or not obtain the information, continue to push the proxy server side View files until the content transmission is complete (that is, full view files are included, or all files needed by the user are included based on user behavior, or content files within a certain range near the user's current view angle are included).

前述流程中内容服务器和代理服务器建立相当的信任关系。内容服务器主动推送业务到代理服务器,由代理服务器支持进行内容分发的优化。该流程非常适用于内容服务商自建代理服务器,或者内容服务商和代理服务器建立稳固合同关系的场景。In the foregoing process, the content server and the proxy server establish a considerable trust relationship. The content server actively pushes services to the proxy server, and the proxy server supports optimization of content distribution. This process is very suitable for the scenario where the content service provider builds its own proxy server, or the content service provider and the proxy server establish a solid contract relationship.

备注:若对应内容文件信息已经完成存储在了代理服务器上,则图2示中的虚线交互不再需要。Note: If the corresponding content file information has been stored on the proxy server, the dotted line interaction shown in Figure 2 is no longer needed.

图3则为本实施例的另一种具体实施方式,与图2所示的方案不同之处在于,所述向代理服务器发送视角文件请求信息之前,向内容服务器发送内容请求;接收到所述代理服务器反馈的其缓存的至少一个视角,或者,接收到所述内容服务器反馈的在所述代理服务器侧缓存的至少一个视角及其链接信息。具体说明如下:Fig. 3 is another specific implementation of this embodiment, which is different from the scheme shown in Fig. 2 in that, before sending the viewing angle file request information to the proxy server, a content request is sent to the content server; At least one viewing angle cached by the proxy server fed back by the proxy server, or at least one viewing angle cached on the proxy server side fed back by the content server and its link information received. The specific instructions are as follows:

1、终端设备向内容服务器发起内容请求;1. The terminal device initiates a content request to the content server;

2、代理服务器识别或者截获终端设备的内容请求,并且由自身代为向内容服务器发起内容请求;2. The proxy server identifies or intercepts the content request of the terminal device, and initiates the content request to the content server by itself;

3、内容服务器向代理服务器反馈所有视角文件url及与对应视角角度的关系;3. The content server feeds back the urls of all view files and the relationship with the corresponding view angles to the proxy server;

与图2所示的流程的区别在于,上一个流程代理服务器和服务器是合作关系,代理服务器适合由内容服务器部署或者两者有协议关系;这个流程可能是一个中立的代理服务器。The difference from the process shown in Figure 2 is that the proxy server and the server in the previous process are in a cooperative relationship, and the proxy server is suitable for deployment by the content server or the two have an agreement relationship; this process may be a neutral proxy server.

4、代理服务器基于内容服务器反馈的信息,生成本地的视角文件url’以及与对应视角角度的关系,并将这个信息分发终端设备;4. Based on the information fed back by the content server, the proxy server generates the local viewing angle file url' and the relationship with the corresponding viewing angle, and distributes this information to the terminal device;

也就是说,将视角、视角文件对应的链接信息进行封装得到封装信息,发送所述封装信息至所述终端设备;That is to say, encapsulating the view and the link information corresponding to the view file to obtain encapsulation information, and sending the encapsulation information to the terminal device;

或者,or,

将视角、视角文件对应的链接信息进行封装得到封装信息,发送所述封装信息至所述内容服务器。Encapsulating the view and the link information corresponding to the view file to obtain encapsulation information, and sending the encapsulation information to the content server.

具体地,这个步骤的处理方式是,代理服务器以一定的方式封装数据包,直接反馈用户;或者,这个步骤进一步区分成为两步,首先,由代理服务器将确定好的代理侧url’以及与对应角度的关系反馈给服务器,然后,由代理服务器反馈终端设备;Specifically, the processing method of this step is that the proxy server encapsulates the data packet in a certain way and directly feeds back to the user; or, this step is further divided into two steps. First, the proxy server will determine the proxy side url' and the corresponding The angle relationship is fed back to the server, and then the proxy server feeds back to the terminal device;

5、终端设备基于代理服务器反馈的信息,选择起始url’,发起内容请求;5. Based on the information fed back by the proxy server, the terminal device selects the starting url' and initiates a content request;

6、代理服务器返回终端设备所请求的视角内容;6. The proxy server returns the viewing angle content requested by the terminal device;

在执行步骤4-6间,代理服务器向内容服务器请求的初始内容(也就是内容请求所对应的当前视角、或当前位置所对应的内容),特别地,如果代理服务器具有用户的视角行为信息,那么可根据其所掌握的信息,选择部分视角文件作为初始传输用。否则,代理服务器可能需要请求传输较全视角文件到代理服务器侧。或者,在带宽相对不充裕的情况下,推迟业务请求,即在收到用户视角请求信息之后,开始进行视角文件的请求,以及进行用户视角邻近视角的业务请求;这个过程持续到用户结束这个业务,或者直到代理服务器获得完整内容(即包含全视角文件,或者基于用户行为判断包含所有用户需要的文件,或者包含用户当前视角附近一定范围的内容文件)。During steps 4-6, the proxy server requests the content server for the initial content (that is, the content corresponding to the current viewing angle corresponding to the content request, or the content corresponding to the current location), especially if the proxy server has the user's viewing angle behavior information, Then, according to the information it possesses, some view files can be selected for initial transmission. Otherwise, the proxy server may need to request to transmit the full-view file to the proxy server side. Or, in the case of relatively insufficient bandwidth, the service request is postponed, that is, after receiving the user's view request information, the request for the view file and the service request for the adjacent view of the user's view are started; this process continues until the user ends the service , or until the proxy server obtains the complete content (that is, contains the full-view file, or contains all the files needed by the user based on user behavior judgment, or contains a certain range of content files near the user's current view).

7、终端设备转动头部,则根据新的角度确定新的视角文件url’信息,并发起内容请求;7. When the terminal device turns its head, it determines the new perspective file url' information according to the new perspective, and initiates a content request;

8、代理服务器根据终端设备更新的视角,返回新视角内容。8. The proxy server returns the content of the new viewing angle according to the updated viewing angle of the terminal device.

图3提供的处理方式中,所涉及的流程适用于代理服务器和终端设备建立了一定的信任关系,能够获得终端设备的请求内容,具体地,由终端设备主动通过代理服务器能够识别的语言透露给代理服务器,或者代理服务器具有解析用户这类请求的能力。该流程非常适用于由网络运营商来提供代理服务器的场景。In the processing method provided in Figure 3, the process involved is applicable to the fact that the proxy server and the terminal device have established a certain trust relationship and can obtain the request content of the terminal device. Specifically, the terminal device actively discloses the content of the request to the A proxy server, or a proxy server has the ability to resolve such requests from users. This process is very applicable to the scenario where the network operator provides the proxy server.

进一步地,若代理服务器,由网络运营商来部署的时候,代理服务器具备较为充分的网络信息。那么代理服务器可以根据不同时间节点网络的负载忙闲状况差异,选择多缓存或者少缓存用户的内容。比如,在初始内容申请时,如果网络状态相对空闲的时候,代理服务器可以一次性帮用户申请更多的内容,并把用户暂时不需要的内容进行缓存。Further, if the proxy server is deployed by the network operator, the proxy server has sufficient network information. Then the proxy server can choose to cache more or less user content according to the difference in the load status of the node network at different times. For example, during the initial content application, if the network status is relatively idle, the proxy server can help the user apply for more content at one time, and cache the content that the user does not need temporarily.

备注:若对应内容文件信息已经完成存储在了代理服务器上,则图3示中的虚线交互不再需要。Note: If the corresponding content file information has been stored on the proxy server, the dotted line interaction shown in Figure 3 is no longer needed.

图4则为再一种处理流程,与图2和图3的不同之处在于,所述向代理服务器发送视角文件请求信息之前,所述方法还包括:与所述代理服务器进行协商,得到交互信令的格式;基于所述交互信令的格式向所述代理服务器发送内容请求;接收到所述代理服务器反馈的其缓存的至少一个视角,或者,接收到所述内容服务器反馈的在所述代理服务器侧缓存的至少一个视角及其链接信息。Fig. 4 is yet another processing flow, which is different from Fig. 2 and Fig. 3 in that, before sending the viewing angle file request information to the proxy server, the method further includes: negotiating with the proxy server to obtain an interactive The format of the signaling; sending a content request to the proxy server based on the format of the interactive signaling; receiving at least one viewing angle of its cache fed back by the proxy server, or receiving the feedback from the content server in the At least one perspective and its link information cached on the proxy server side.

其中,协商的过程,包括通过网络的标准化,允许用户发送网络可识别的信令,告知网络面向网络部署的代理服务器,进行对应内容请求;Among them, the negotiation process, including the standardization of the network, allows users to send network-recognizable signaling to inform the network-oriented proxy server deployed on the network to request corresponding content;

另外,步骤1中,协商得到的请求内容包括:基于所述的信令格式,也就是填充对应的信息,比如内容url,通过信令封装,传递给代理服务器。In addition, in step 1, the negotiated request content includes: based on the signaling format, that is, fill in the corresponding information, such as the content url, encapsulate it through signaling, and transmit it to the proxy server.

所述提案适用于所有涉及的角度交互或者类似角度交互的内容分发的,内容优化。The proposal is applicable to all content distribution and content optimization involving angle interaction or similar angle interaction.

图4的剩余步骤的处理方式与图3相同,这里不再进行赘述。The processing manner of the remaining steps in FIG. 4 is the same as that in FIG. 3 , and will not be repeated here.

可见,通过采用本实施例提供的方案,就能够由代理服务器预先进行视角及其对应的视角文件的缓存,然后由代理服务器响应终端设备的视角文件请求信息为所述终端设备反馈目标视角对应的目标视角文件。如此,就能够快速响应用户业务的需求,减少终端设备获取视角文件的时延,避免用户使用终端设备的不适感。It can be seen that by adopting the solution provided in this embodiment, the proxy server can pre-cache the view angle and the corresponding view file, and then the proxy server can respond to the view file request information of the terminal device to feed back the corresponding view file for the terminal device. Target view file. In this way, it is possible to quickly respond to the user's business needs, reduce the time delay for the terminal device to obtain the view file, and avoid the user's discomfort when using the terminal device.

实施例三、Embodiment three,

本发明实施例提供了一种信息传输方法,应用于内容服务器,包括:An embodiment of the present invention provides an information transmission method applied to a content server, including:

基于终端设备发出的内容请求,向终端设备的代理服务器发送缓存内容;其中,所述缓存内容为与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件。Based on the content request sent by the terminal device, the cache content is sent to the proxy server of the terminal device; wherein the cache content is at least one view corresponding to the content request sent by the terminal device, and a view file corresponding to each view.

本实施例中,所述终端设备具体可以为能够运行VR/AR的终端设备,内容服务器也为能够提供VR/AR的内容服务器。In this embodiment, the terminal device may specifically be a terminal device capable of running VR/AR, and the content server may also be a content server capable of providing VR/AR.

在终端设备的用户视角发生变化之前,代理服务器跟远端的内容服务器交互,预先缓存对应的视角文件;缓存的视角及其对应的视角文件可以是终端设备的用户在初始接入系统时所在的当前视角附近的视角及其对应的视角文件;或者,可以为代理服务器根据掌握的用户视角行为习惯预测得到的用户常用的至少一个视角及其对应的视角文件;或者,还可以为所述代理服务器在所述终端设备的用户在当前视角以外的至少一个预设视角及其对应的视角文件;Before the user's perspective of the terminal device changes, the proxy server interacts with the remote content server to pre-cache the corresponding perspective file; the cached perspective and its corresponding perspective file can be the location where the user of the terminal device initially accesses the system. The angle of view near the current angle of view and its corresponding angle of view file; or, it may be at least one angle of view commonly used by the user and its corresponding angle of view file predicted by the proxy server according to the mastered user's angle of view behavior habits; or, it may also be the proxy server At least one preset viewing angle other than the current viewing angle of the user of the terminal device and its corresponding viewing angle file;

当终端设备的用户视角发生变化时,所述终端设备向代理服务器发来新的视角文件请求信息,代理服务器基于视角文件请求信息,从预先缓存的视角对应的视角文件分发用户。When the user's perspective of the terminal device changes, the terminal device sends a new perspective file request information to the proxy server, and the proxy server distributes the perspective file corresponding to the perspective cached in advance to the user based on the perspective file request information.

具体来说,所述向终端设备的代理服务器发送缓存内容,包括:Specifically, the sending cached content to the proxy server of the terminal device includes:

向所述内容服务器侧,发出与的内容请求对应的全部视角、以及每一个视角对应的视角文件;其中,所述内容请求中可以包括有至少一个维度的内容,比如,可以包括有终端设备的当前位置、当前视角等信息中的至少之一。可以理解的是,可以根据内容请求中的当前位置确定终端设备所要获取到的内容是什么,直接根据其对应的位置得知该位置处的全部视角以及每一个视角对应的视角文件。To the content server side, send all viewing angles corresponding to the content request and the viewing angle file corresponding to each viewing angle; wherein, the content request may include content with at least one dimension, for example, may include a terminal device At least one of information such as the current position and the current viewing angle. It can be understood that the content to be obtained by the terminal device can be determined according to the current location in the content request, and all the viewing angles at the location and the viewing angle files corresponding to each viewing angle can be obtained directly according to the corresponding location.

或者,or,

向所述内容服务器侧,发出与所述终端设备的常用视角及其对应的视角文件;sending the commonly used viewing angles of the terminal device and corresponding viewing angle files to the content server side;

需要理解的是,这种处理方式建立在终端设备已有常用视角,或者代理服务器至少获取到终端设备的至少一次行为记录的基础上才能实现;基于终端设备的至少一次行为记录可以包括有终端设备通常会获取到N个请求获取的视角文件的视角为哪些,根据这样的分析得到终端设备的常用视角。It should be understood that this processing method can only be realized on the basis that the terminal device has a common perspective, or the proxy server has at least obtained at least one behavior record of the terminal device; based on the at least one behavior record of the terminal device may include Usually, what are the viewing angles of the N requested viewing angle files are obtained, and the commonly used viewing angles of the terminal device are obtained according to such analysis.

或者,or,

向所述内容服务器侧,发出与终端设备当前视角对应的视角文件,并获取到所述当前视角的至少一个相关视角及其对应的视角文件;其中,所述相关视角表征与所述当前视角之间的角度差值小于预设门限值的视角。所述预设门限值可以根据实际情况进行设置,比如可以为左右30度之内,或者还可以包含上下30度之内。To the content server side, send a viewing angle file corresponding to the current viewing angle of the terminal device, and obtain at least one related viewing angle of the current viewing angle and its corresponding viewing angle file; The angle difference between them is smaller than the preset threshold value. The preset threshold value can be set according to the actual situation, for example, it can be within 30 degrees left and right, or it can also be included within 30 degrees up and down.

需要说明的是,终端设备侧可以保存的内容为至少一个视角及其对应的链接信息;It should be noted that the content that can be stored on the terminal device side is at least one viewing angle and its corresponding link information;

当终端设备发起视角文件请求信息时,可以包括有一个具体的视角,也可以为根据所述视角首先确定其对应的连接信息,然后直接向代理服务器发送包含有视角(或视角文件)对应的链接信息作为所述视角文件请求信息;When a terminal device initiates a view file request message, it may include a specific view, or first determine its corresponding connection information according to the view, and then directly send a link containing the view (or view file) to the proxy server information as the view file request information;

相应的,业务服务器可以基于视角服务器中的视角,从自身缓存内容中选取得到目标视角文件;Correspondingly, the service server can select the target view file from its own cache content based on the view in the view server;

或者,所述业务服务器可以基于视角文件请求信息中的视角的链接信息,直接获取到对应的目标视角文件。Alternatively, the service server may directly acquire the corresponding target view file based on the view link information in the view file request information.

所述方法还包括:向所述代理服务器发送新的至少一个视角以及每一个新的视角所对应的视角文件,其中,所述新的至少一个视角及其对应的视角文件用于更新所述代理服务器的缓存内容。The method further includes: sending at least one new perspective and a perspective file corresponding to each new perspective to the proxy server, wherein the at least one new perspective and its corresponding perspective file are used to update the agent The server's cache content.

也就是说,所述代理服务器还可以根据用户视角、或者基于缺失的视角文件,持续跟所述内容服务器进行交互以获取更新的缓存内容。That is to say, the proxy server may continue to interact with the content server to obtain updated cached content according to the user's perspective or based on a missing perspective file.

具体的,所述若所述代理服务器未保存有所述终端设备发出的内容请求对应的全部视角及其对应的文件,则从所述内容服务器获取到新的至少一个视角以及每一个新的视角所对应的视角文件,包括:Specifically, if the proxy server does not store all the views corresponding to the content request sent by the terminal device and their corresponding files, at least one new view and each new view may be obtained from the content server The corresponding perspective files include:

基于接收到的视角文件请求信息所对应的视角,对所述终端设备需要获取的至少一个视角进行预测,得到至少一个预测视角;Based on the angle of view corresponding to the received angle of view file request information, predict at least one angle of view to be acquired by the terminal device to obtain at least one predicted angle of view;

判断已有的缓存内容中是否保存有所述至少一个预测视角及其对应的视角文件;Judging whether the at least one predicted viewing angle and its corresponding viewing angle file are stored in the existing cache content;

若未保存,则基于所述至少一个预测视角从所述内容服务器侧获取到新的至少一个视角以及每一个新的视角所对应的视角文件。If not saved, at least one new viewing angle and a viewing angle file corresponding to each new viewing angle are acquired from the content server side based on the at least one predicted viewing angle.

基于前述的方案,如图2所示为其中一种实施流程,具体说明如下:Based on the aforementioned scheme, one of the implementation processes is shown in Figure 2, and the specific description is as follows:

1、终端设备向内容服务器发起内容请求;其中,所述内容请求可以包括有多个维度内容,比如可以包括以下至少之一:当前的角度信息,当前的位置信息等;或者,可以理解为向内容服务器发送的建立连接的请求信息;1. The terminal device initiates a content request to the content server; wherein, the content request may include multiple dimensions of content, for example, it may include at least one of the following: current angle information, current location information, etc.; or, it can be understood as requesting The request information sent by the content server to establish a connection;

2、内容服务器和代理服务器沟通同步不同视角文件在代理服务器侧的 url’信息以及之间的角度关系;2. The content server and the proxy server communicate and synchronize the url' information of different perspective files on the proxy server side and the angle relationship between them;

具体地,这个url’信息可以由内容服务器生成,并通知代理服务器进行配置,或者,可以由代理服务器生成,服务器向代理服务器发起请求并获得代理服务器侧对应业务的url’信息。其中,若由代理服务器生成并从内容服务器获取的话,可以通过内容服务器向代理服务器发送终端设备已经发起内容请求的通知后,代理服务器向内容服务器发送所要获取的URL信息的请求。Specifically, the url' information may be generated by the content server and notify the proxy server to configure, or may be generated by the proxy server, and the server initiates a request to the proxy server and obtains the url' information of the corresponding service on the proxy server side. Wherein, if generated by the proxy server and obtained from the content server, the proxy server may send a request for URL information to be obtained to the content server after the content server sends a notification that the terminal device has initiated a content request to the proxy server.

可能并行地,内容服务器面向代理服务器推送初始内容,特别地,如果内容服务器具有用户的视角行为信息,那么可根据其所掌握的信息,选择部分视角文件作为初始传输用;否则,如果内容服务器不具有用户的视角行为信息,内容服务器可能需要传输较全视角文件到代理服务器侧。或者,在带宽相对不充裕的情况下,推迟业务推送,即在收到用户视角请求信息之后,开始进行视角文件的推送,以及进行用户视角邻近视角的业务推送;Perhaps in parallel, the content server pushes the initial content to the proxy server. In particular, if the content server has the user’s perspective behavior information, it can select some perspective files for initial transmission according to the information it has; otherwise, if the content server does not With the viewing angle behavior information of the user, the content server may need to transmit a more comprehensive viewing angle file to the proxy server side. Or, when the bandwidth is relatively insufficient, the service push is postponed, that is, after receiving the request information of the user's perspective, the push of the perspective file is started, and the business push of the adjacent perspective of the user's perspective is carried out;

其中,所述配置代理服务器需要同内容服务器统一用户请求内容,在代理服务器侧的位置,代理服务器需要能够代替用户跟内容服务器请求内容,并作内容缓存;在用户真正做内容请求的时候,将内容分发用户,并进一步跟内容服务器要求用户请求或者下一步可能请求、但是尚未存储在代理服务器的内容;Wherein, the configuration of the proxy server needs to unify the content requested by the user with the content server. At the position of the proxy server, the proxy server needs to be able to replace the user to request content with the content server and cache the content; when the user actually makes a content request, the Content distribution users, and further ask the content server to request the content that the user requests or may request in the next step, but has not been stored in the proxy server;

配置的生成可以为:服务器可以告诉代理服务器,多维内容对应的维度以及各个维度内容文件位置,由代理服务器决策,多维内容各个维度内容文件在代理服务器对应的位置;The generation of configuration can be as follows: the server can tell the proxy server, the dimension corresponding to the multi-dimensional content and the location of the content file of each dimension are decided by the proxy server, and the content file of each dimension of the multi-dimensional content is in the corresponding position of the proxy server;

视角行为信息可以理解为,每一个视角获取周期,获取到的视角;比如1,视角轨迹1->3->2->…,以及视角轨迹变换的周期、时刻等。Viewpoint behavior information can be understood as each viewing angle acquisition cycle, the obtained viewing angle; for example, 1, viewing angle trajectory 1->3->2->..., and the cycle and time of viewing angle trajectory transformation.

需要说明的是,内容请求中并不一定携带视角,传统流程是在内容请求成功之后,开始请求视角;在正式的视角请求之前,基于前面所述的视角行为信息,先缓存部分内容。It should be noted that the content request does not necessarily carry the perspective. The traditional process is to start requesting the perspective after the content request is successful; before the formal perspective request, based on the above-mentioned perspective behavior information, first cache some content.

3、内容服务器面向终端设备返回代理服务器侧对应所有视角文件url’信息,以及之间的角度关系;3. The content server returns to the terminal device the url' information corresponding to all view files on the proxy server side, as well as the angle relationship between them;

4、终端设备基于收到的视角文件url’信息,选择起始url’,请求对应视角的内容文件;终端收到的是视角配置文件,比如什么样的视角对应什么样的url;基于这个信息,终端基于自己的视角,选择对应的url,进行请求4. Based on the received view file url' information, the terminal device selects the starting url' and requests the content file of the corresponding view; the terminal receives the view configuration file, such as what view corresponds to what url; based on this information , the terminal selects the corresponding url based on its own perspective, and makes a request

5、代理服务器返回终端设备所请求的视角文件url’信息;5. The proxy server returns the perspective file url' information requested by the terminal device;

6、终端设备随着用户转动头部,则根据新的角度确定新的视角文件url’信息,并发起内容请求;6. The terminal device determines the new perspective file url' information according to the new perspective as the user turns the head, and initiates a content request;

7、代理服务器根据终端设备更新的视角,返回新视角内容。7. The proxy server returns the content of the new viewing angle according to the updated viewing angle of the terminal device.

需要指出的是,在4步骤-7期间,内容服务器可能收到来自代理服务器反馈的终端的视角行为信息,比如终端视角请求信息,并基于获取的信息、或者没有获取信息,持续推送代理服务器侧的视角文件,直到内容传输完整 (即包含全视角文件,或者基于用户行为判断包含所有用户需要的文件,或者包含用户当前视角附近一定范围的内容文件)。It should be pointed out that during Step 4-7, the content server may receive the viewing angle behavior information of the terminal fed back from the proxy server, such as the terminal viewing angle request information, and based on the obtained information or not obtain the information, continue to push the proxy server side View files until the content transmission is complete (that is, full view files are included, or all files needed by the user are included based on user behavior, or content files within a certain range near the user's current view angle are included).

前述流程中内容服务器和代理服务器建立相当的信任关系。内容服务器主动推送业务到代理服务器,由代理服务器支持进行内容分发的优化。该流程非常适用于内容服务商自建代理服务器,或者内容服务商和代理服务器建立稳固合同关系的场景。In the foregoing process, the content server and the proxy server establish a considerable trust relationship. The content server actively pushes services to the proxy server, and the proxy server supports optimization of content distribution. This process is very suitable for the scenario where the content service provider builds its own proxy server, or the content service provider and the proxy server establish a solid contract relationship.

备注:若对应内容文件信息已经完成存储在了代理服务器上,则图2示中的虚线交互不再需要。Note: If the corresponding content file information has been stored on the proxy server, the dotted line interaction shown in Figure 2 is no longer needed.

图3则为本实施例的另一种具体实施方式,与图2所示的方案不同之处在于,所述从终端设备的内容服务器侧获取到缓存内容之前,所述方法还包括:获取到所述终端设备向所述内容服务器发送的内容请求;基于所述内容请求,向所述内容服务器侧请求获取缓存内容。具体说明如下:Fig. 3 is another specific implementation of this embodiment, which is different from the solution shown in Fig. 2 in that before obtaining the cached content from the content server side of the terminal device, the method further includes: obtaining The content request sent by the terminal device to the content server; based on the content request, request the content server to acquire cached content. The specific instructions are as follows:

1、终端设备向内容服务器发起内容请求;1. The terminal device initiates a content request to the content server;

2、代理服务器识别或者截获终端设备的内容请求,并且由自身代为向内容服务器发起内容请求;2. The proxy server identifies or intercepts the content request of the terminal device, and initiates the content request to the content server by itself;

3、内容服务器向代理服务器反馈所有视角文件url及与对应视角角度的关系;3. The content server feeds back the urls of all view files and the relationship with the corresponding view angles to the proxy server;

与图2所示的流程的区别在于,上一个流程代理服务器和服务器是合作关系,代理服务器适合由内容服务器部署或者两者有协议关系;这个流程可能是一个中立的代理服务器。The difference from the process shown in Figure 2 is that the proxy server and the server in the previous process are in a cooperative relationship, and the proxy server is suitable for deployment by the content server or the two have an agreement relationship; this process may be a neutral proxy server.

4、代理服务器基于内容服务器反馈的信息,生成本地的视角文件url’以及与对应视角角度的关系,并将这个信息分发终端设备;4. Based on the information fed back by the content server, the proxy server generates the local viewing angle file url' and the relationship with the corresponding viewing angle, and distributes this information to the terminal device;

也就是说,将视角、视角文件对应的链接信息进行封装得到封装信息,发送所述封装信息至所述终端设备;That is to say, encapsulating the view and the link information corresponding to the view file to obtain encapsulation information, and sending the encapsulation information to the terminal device;

或者,or,

将视角、视角文件对应的链接信息进行封装得到封装信息,发送所述封装信息至所述内容服务器。Encapsulating the view and the link information corresponding to the view file to obtain encapsulation information, and sending the encapsulation information to the content server.

具体地,这个步骤的处理方式是,代理服务器以一定的方式封装数据包,直接反馈用户;或者,这个步骤进一步区分成为两步,首先,由代理服务器将确定好的代理侧url’以及与对应角度的关系反馈给服务器,然后,由代理服务器反馈终端设备;Specifically, the processing method of this step is that the proxy server encapsulates the data packet in a certain way and directly feeds back to the user; or, this step is further divided into two steps. First, the proxy server will determine the proxy side url' and the corresponding The angle relationship is fed back to the server, and then the proxy server feeds back to the terminal device;

5、终端设备基于代理服务器反馈的信息,选择起始url’,发起内容请求;5. Based on the information fed back by the proxy server, the terminal device selects the starting url' and initiates a content request;

6、代理服务器返回终端设备所请求的视角内容;6. The proxy server returns the viewing angle content requested by the terminal device;

在执行步骤4-6间,代理服务器向内容服务器请求的初始内容(也就是内容请求所对应的当前视角、或当前位置所对应的内容),特别地,如果代理服务器具有用户的视角行为信息,那么可根据其所掌握的信息,选择部分视角文件作为初始传输用。否则,代理服务器可能需要请求传输较全视角文件到代理服务器侧。或者,在带宽相对不充裕的情况下,推迟业务请求,即在收到用户视角请求信息之后,开始进行视角文件的请求,以及进行用户视角邻近视角的业务请求;这个过程持续到用户结束这个业务,或者直到代理服务器获得完整内容(即包含全视角文件,或者基于用户行为判断包含所有用户需要的文件,或者包含用户当前视角附近一定范围的内容文件)。During steps 4-6, the proxy server requests the content server for the initial content (that is, the content corresponding to the current viewing angle corresponding to the content request, or the content corresponding to the current location), especially if the proxy server has the user's viewing angle behavior information, Then, according to the information it possesses, some view files can be selected for initial transmission. Otherwise, the proxy server may need to request to transmit the full-view file to the proxy server side. Or, in the case of relatively insufficient bandwidth, the service request is postponed, that is, after receiving the user's view request information, the request for the view file and the service request for the adjacent view of the user's view are started; this process continues until the user ends the service , or until the proxy server obtains the complete content (that is, contains the full-view file, or contains all the files needed by the user based on user behavior judgment, or contains a certain range of content files near the user's current view).

7、终端设备转动头部,则根据新的角度确定新的视角文件url’信息,并发起内容请求;7. When the terminal device turns its head, it determines the new perspective file url' information according to the new perspective, and initiates a content request;

8、代理服务器根据终端设备更新的视角,返回新视角内容。8. The proxy server returns the content of the new viewing angle according to the updated viewing angle of the terminal device.

图3提供的处理方式中,所涉及的流程适用于代理服务器和终端设备建立了一定的信任关系,能够获得终端设备的请求内容,具体地,由终端设备主动通过代理服务器能够识别的语言透露给代理服务器,或者代理服务器具有解析用户这类请求的能力。该流程非常适用于由网络运营商来提供代理服务器的场景。In the processing method provided in Figure 3, the process involved is applicable to the fact that the proxy server and the terminal device have established a certain trust relationship and can obtain the request content of the terminal device. Specifically, the terminal device actively discloses the content of the request to the A proxy server, or a proxy server has the ability to resolve such requests from users. This process is very applicable to the scenario where the network operator provides the proxy server.

进一步地,若代理服务器,由网络运营商来部署的时候,代理服务器具备较为充分的网络信息。那么代理服务器可以根据不同时间节点网络的负载忙闲状况差异,选择多缓存或者少缓存用户的内容。比如,在初始内容申请时,如果网络状态相对空闲的时候,代理服务器可以一次性帮用户申请更多的内容,并把用户暂时不需要的内容进行缓存。Further, if the proxy server is deployed by the network operator, the proxy server has sufficient network information. Then the proxy server can choose to cache more or less user content according to the difference in the load status of the node network at different times. For example, during the initial content application, if the network status is relatively idle, the proxy server can help the user apply for more content at one time, and cache the content that the user does not need temporarily.

备注:若对应内容文件信息已经完成存储在了代理服务器上,则图3示中的虚线交互不再需要。Note: If the corresponding content file information has been stored on the proxy server, the dotted line interaction shown in Figure 3 is no longer needed.

图4则为再一种处理流程,与图2和图3的不同之处在于,所述从终端设备的内容服务器侧获取到缓存内容之前,所述方法还包括:与所述终端设备进行协商,得到交互信令的格式;接收到所述终端设备基于所述交互信令的格式发来的内容请求;基于所述内容请求,向所述内容服务器侧请求获取缓存内容;其中,协商的过程,包括通过网络的标准化,允许用户发送网络可识别的信令,告知网络面向网络部署的代理服务器,进行对应内容请求;Fig. 4 is yet another processing flow, which is different from Fig. 2 and Fig. 3 in that, before obtaining the cached content from the content server side of the terminal device, the method further includes: negotiating with the terminal device , obtain the format of the interactive signaling; receive the content request sent by the terminal device based on the format of the interactive signaling; based on the content request, request the content server side to obtain cached content; wherein, the process of negotiation , including through the standardization of the network, allowing users to send network-recognizable signaling to inform the network-oriented proxy server deployed on the network to make corresponding content requests;

另外,步骤1中,协商得到的请求内容包括:基于所述的信令格式,也就是填充对应的信息,比如内容url,通过信令封装,传递给代理服务器。In addition, in step 1, the negotiated request content includes: based on the signaling format, that is, fill in the corresponding information, such as the content url, encapsulate it through signaling, and transmit it to the proxy server.

所述提案适用于所有涉及的角度交互或者类似角度交互的内容分发的,内容优化。The proposal is applicable to all content distribution and content optimization involving angle interaction or similar angle interaction.

图4的剩余步骤的处理方式与图3相同,这里不再进行赘述。The processing manner of the remaining steps in FIG. 4 is the same as that in FIG. 3 , and will not be repeated here.

可见,通过采用本实施例提供的方案,就能够由代理服务器预先进行视角及其对应的视角文件的缓存,然后由代理服务器响应终端设备的视角文件请求信息为所述终端设备反馈目标视角对应的目标视角文件。如此,就能够快速响应用户业务的需求,减少终端设备获取视角文件的时延,避免用户使用终端设备的不适感。It can be seen that by adopting the solution provided in this embodiment, the proxy server can pre-cache the view angle and the corresponding view file, and then the proxy server can respond to the view file request information of the terminal device to feed back the corresponding view file for the terminal device. Target view file. In this way, it is possible to quickly respond to the user's business needs, reduce the time delay for the terminal device to obtain the view file, and avoid the user's discomfort when using the terminal device.

实施例四、Embodiment four,

本发明实施例提供了一种代理服务器,如图6所示,包括:An embodiment of the present invention provides a proxy server, as shown in Figure 6, including:

缓存获取单元61,用于从终端设备的内容服务器侧获取到缓存内容;其中,所述缓存内容为与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件;The cache obtaining unit 61 is configured to obtain cached content from the content server side of the terminal device; wherein, the cached content is at least one view corresponding to the content request sent by the terminal device, and a view file corresponding to each view ;

终端通信单元62,用于接收到所述终端设备发来的视角文件请求信息;基于所述视角文件请求信息,从所述缓存内容中选取得到所述目标视角所对应的目标视角文件,发送所述目标视角文件至所述终端设备。。The terminal communication unit 62 is configured to receive the viewing angle file request information sent by the terminal device; based on the viewing angle file request information, select the target viewing angle file corresponding to the target viewing angle from the cache content, and send the The target view file is sent to the terminal device. .

本实施例中,所述终端设备具体可以为能够运行VR/AR的终端设备,内容服务器也为能够提供VR/AR的内容服务器。In this embodiment, the terminal device may specifically be a terminal device capable of running VR/AR, and the content server may also be a content server capable of providing VR/AR.

在终端设备的用户视角发生变化之前,代理服务器跟远端的内容服务器交互,预先缓存对应的视角文件;缓存的视角及其对应的视角文件可以是终端设备的用户在初始接入系统时所在的当前视角附近的视角及其对应的视角文件;或者,可以为代理服务器根据掌握的用户视角行为习惯预测得到的用户常用的至少一个视角及其对应的视角文件;或者,还可以为所述代理服务器在所述终端设备的用户在当前视角以外的至少一个预设视角及其对应的视角文件;Before the user's perspective of the terminal device changes, the proxy server interacts with the remote content server to pre-cache the corresponding perspective file; the cached perspective and its corresponding perspective file can be the location where the user of the terminal device initially accesses the system. The angle of view near the current angle of view and its corresponding angle of view file; or, it may be at least one angle of view commonly used by the user and its corresponding angle of view file predicted by the proxy server according to the mastered user's angle of view behavior habits; or, it may also be the proxy server At least one preset viewing angle other than the current viewing angle of the user of the terminal device and its corresponding viewing angle file;

当终端设备的用户视角发生变化时,所述终端设备向代理服务器发来新的视角文件请求信息,代理服务器基于视角文件请求信息,从预先缓存的视角对应的视角文件分发用户。When the user's perspective of the terminal device changes, the terminal device sends a new perspective file request information to the proxy server, and the proxy server distributes the perspective file corresponding to the perspective cached in advance to the user based on the perspective file request information.

具体来说,所述缓存获取单元,用于Specifically, the cache acquisition unit is used for

从所述终端设备的内容服务器侧,获取到终端设备发出的内容请求对应的全部视角、以及每一个视角对应的视角文件;其中,所述内容请求中可以包括有至少一个维度的内容,比如,可以包括有终端设备的当前位置、当前视角等信息中的至少之一。可以理解的是,可以根据内容请求中的当前位置确定终端设备所要获取到的内容是什么,直接根据其对应的位置得知该位置处的全部视角以及每一个视角对应的视角文件。From the content server side of the terminal device, obtain all the views corresponding to the content request sent by the terminal device, and the view file corresponding to each view; wherein, the content request may include content with at least one dimension, for example, At least one of information such as a current location and a current viewing angle of the terminal device may be included. It can be understood that the content to be obtained by the terminal device can be determined according to the current location in the content request, and all the viewing angles at the location and the viewing angle files corresponding to each viewing angle can be obtained directly according to the corresponding location.

或者,or,

从所述终端设备的内容服务器侧,获取到终端设备的常用视角及其对应的视角文件;需要理解的是,这种处理方式建立在终端设备已有常用视角,或者代理服务器至少获取到终端设备的至少一次行为记录的基础上才能实现;基于终端设备的至少一次行为记录可以包括有终端设备通常会获取到N个请求获取的视角文件的视角为哪些,根据这样的分析得到终端设备的常用视角。From the content server side of the terminal device, the commonly used viewing angles of the terminal device and their corresponding viewing angle files are obtained; it should be understood that this processing method is based on the fact that the terminal device already has a commonly used viewing angle, or the proxy server at least obtains the terminal device It can only be realized on the basis of at least one behavior record of the terminal device; based on at least one behavior record of the terminal device, it can include the perspectives of the N requesting perspective files that the terminal device usually obtains, and according to such analysis, the common perspective of the terminal device can be obtained .

或者,or,

从所述终端设备的内容服务器侧,获取到终端设备当前视角对应的视角文件,并获取到所述当前视角的至少一个相关视角及其对应的视角文件;其中,所述相关视角表征与所述当前视角之间的角度差值小于预设门限值的视角。所述预设门限值可以根据实际情况进行设置,比如可以为左右30度之内,或者还可以包含上下30度之内。From the content server side of the terminal device, the viewing angle file corresponding to the current viewing angle of the terminal device is obtained, and at least one related viewing angle of the current viewing angle and its corresponding viewing angle file are obtained; wherein, the related viewing angle representation is the same as the The angle difference between the current angles of view is smaller than the preset threshold value. The preset threshold value can be set according to the actual situation, for example, it can be within 30 degrees left and right, or it can also be included within 30 degrees up and down.

需要说明的是,终端设备侧可以保存的内容为至少一个视角及其对应的链接信息;It should be noted that the content that can be stored on the terminal device side is at least one viewing angle and its corresponding link information;

当终端设备发起视角文件请求信息时,可以包括有一个具体的视角,也可以为根据所述视角首先确定其对应的连接信息,然后直接向代理服务器发送包含有视角(或视角文件)对应的链接信息作为所述视角文件请求信息;When a terminal device initiates a view file request message, it may include a specific view, or first determine its corresponding connection information according to the view, and then directly send a link containing the view (or view file) to the proxy server information as the view file request information;

相应的,业务服务器可以基于视角服务器中的视角,从自身缓存内容中选取得到目标视角文件;Correspondingly, the service server can select the target view file from its own cache content based on the view in the view server;

或者,所述业务服务器可以基于视角文件请求信息中的视角的链接信息,直接获取到对应的目标视角文件。Alternatively, the service server may directly acquire the corresponding target view file based on the view link information in the view file request information.

所述缓存获取单元,用于若所述代理服务器未保存有所述终端设备发出的内容请求对应的全部视角及其对应的文件,则从所述内容服务器获取到新的至少一个视角以及每一个新的视角所对应的视角文件;The cache obtaining unit is configured to obtain at least one new view and each The view file corresponding to the new view;

基于所述新的至少一个视角及其对应的视角文件更新的缓存内容。The updated cache content based on the at least one new view angle and its corresponding view file.

也就是说,所述代理服务器还可以根据用户视角、或者基于缺失的视角文件,持续跟所述内容服务器进行交互以获取更新的缓存内容。That is to say, the proxy server may continue to interact with the content server to obtain updated cached content according to the user's perspective or based on a missing perspective file.

具体的,所述缓存获取单元,用于基于接收到的视角文件请求信息所对应的视角,对所述终端设备需要获取的至少一个视角进行预测,得到至少一个预测视角;Specifically, the cache acquisition unit is configured to predict at least one viewing angle to be acquired by the terminal device based on the viewing angle corresponding to the received viewing angle file request information, and obtain at least one predicted viewing angle;

判断已有的缓存内容中是否保存有所述至少一个预测视角及其对应的视角文件;Judging whether the at least one predicted viewing angle and its corresponding viewing angle file are stored in the existing cache content;

若未保存,则基于所述至少一个预测视角从所述内容服务器侧获取到新的至少一个视角以及每一个新的视角所对应的视角文件。If not saved, at least one new viewing angle and a viewing angle file corresponding to each new viewing angle are acquired from the content server side based on the at least one predicted viewing angle.

进一步地,本实施例还可以应用到多维内容的传输处理中。通过在终端获取内容的过程中,基于预获取的终端行为数据或者预测的终端行为数据,提取终端下一步会用到的信息更多维度的内容,放到代理设备中进行存储。一旦终端需要,则将内容下发终端。Furthermore, this embodiment can also be applied to transmission processing of multi-dimensional content. In the process of acquiring content by the terminal, based on the pre-acquired terminal behavior data or predicted terminal behavior data, more dimensional content of information that the terminal will use in the next step is extracted and stored in the proxy device. Once the terminal needs it, the content will be delivered to the terminal.

其中,所述预测的方法,可以为如果代理服务器,记录了用户的历史行为;用户在过去请求中的优先选择内容维度1,轨迹是1->3->2,那么就能够比较容易确定预缓存的内容维度,比如当前用户看维度1,那么在用户做进一步请求之前,预缓存内容3;预测所得到的内容可能是预缓存内容3,或者预缓存内容3和2。可能取决于对用户读取内容的速度以及用户可用传输带宽的综合判断。Wherein, the prediction method can be as follows: if the proxy server records the user's historical behavior; the user's preferred content dimension 1 in the past request, the trajectory is 1->3->2, then it is relatively easy to determine the prediction Cache content dimension, for example, if the current user looks at dimension 1, then before the user makes further requests, pre-cache content 3; the predicted content may be pre-cache content 3, or pre-cache content 3 and 2. It may depend on the comprehensive judgment of the user's reading speed and the user's available transmission bandwidth.

进一步地,代理服务器从内容服务器中获取到内容请求所对应的全部视角及其视角文件,还是仅获取部分视角及其对应的视角文件的判定方法可以如下:所述代理服务器还包括:Further, the method for determining whether the proxy server acquires all the views and view files corresponding to the content request from the content server, or only obtains part of the views and the corresponding view files may be as follows: the proxy server further includes:

处理单元63,用于至少基于所述终端设备的属性信息,确定从所述内容服务器获取的缓存内容中所包含的视角及其对应的视角文件的数量;The processing unit 63 is configured to determine, based at least on the attribute information of the terminal device, the number of views contained in the cached content obtained from the content server and the number of corresponding view files;

其中,所述属性信息中包括以下信息至少之一:Wherein, the attribute information includes at least one of the following information:

所述终端设备中视角刷新速度;The viewing angle refresh rate in the terminal device;

所述终端设备的可用传输带宽;The available transmission bandwidth of the terminal device;

所述终端设备的最大传输带宽。The maximum transmission bandwidth of the terminal device.

其中,关于所述终端设备中视角刷新速度,可以为用户读取速度比如根据用户改变视角的速度来定,用户的可用传输带宽可以通过终端设备接入系统时获取到的终端设备的属性信息、或者网络属性确定。关于终端设备的属性信息可以为终端设备的最大接入带宽、网络属性可以为网络传输带宽等等;进一步来说,用户改变视角的速度越快,预缓存的视角文件可以越多,另外,终端设备对应的带宽越快预先缓存的视角文件也可以越多。Wherein, regarding the refreshing speed of the viewing angle in the terminal device, it can be determined by the user reading speed, for example, according to the speed at which the user changes the viewing angle, and the available transmission bandwidth of the user can be obtained through the attribute information of the terminal device obtained when the terminal device accesses the system, Or the network attribute is determined. The attribute information about the terminal device can be the maximum access bandwidth of the terminal device, the network attribute can be the network transmission bandwidth, etc.; further, the faster the user changes the viewing angle, the more viewing angle files can be pre-cached. In addition, the terminal The faster the corresponding bandwidth of the device, the more view files can be pre-cached.

基于前述的方案,如图2所示为其中一种实施流程,具体说明如下:Based on the aforementioned scheme, one of the implementation processes is shown in Figure 2, and the specific description is as follows:

1、终端设备向内容服务器发起内容请求;其中,所述内容请求可以包括有多个维度内容,比如可以包括以下至少之一:当前的角度信息,当前的位置信息等;或者,可以理解为向内容服务器发送的建立连接的请求信息;1. The terminal device initiates a content request to the content server; wherein, the content request may include multiple dimensions of content, for example, it may include at least one of the following: current angle information, current location information, etc.; or, it can be understood as requesting The request information sent by the content server to establish a connection;

2、内容服务器和代理服务器沟通同步不同视角文件在代理服务器侧的 url’信息以及之间的角度关系;2. The content server and the proxy server communicate and synchronize the url' information of different perspective files on the proxy server side and the angle relationship between them;

具体地,这个url’信息可以由内容服务器生成,并通知代理服务器进行配置,或者,可以由代理服务器生成,服务器向代理服务器发起请求并获得代理服务器侧对应业务的url’信息。其中,若由代理服务器生成并从内容服务器获取的话,可以通过内容服务器向代理服务器发送终端设备已经发起内容请求的通知后,代理服务器向内容服务器发送所要获取的URL信息的请求。Specifically, the url' information may be generated by the content server and notify the proxy server to configure, or may be generated by the proxy server, and the server initiates a request to the proxy server and obtains the url' information of the corresponding service on the proxy server side. Wherein, if generated by the proxy server and obtained from the content server, the proxy server may send a request for URL information to be obtained to the content server after the content server sends a notification that the terminal device has initiated a content request to the proxy server.

可能并行地,内容服务器面向代理服务器推送初始内容,特别地,如果内容服务器具有用户的视角行为信息,那么可根据其所掌握的信息,选择部分视角文件作为初始传输用;否则,如果内容服务器不具有用户的视角行为信息,内容服务器可能需要传输较全视角文件到代理服务器侧。或者,在带宽相对不充裕的情况下,推迟业务推送,即在收到用户视角请求信息之后,开始进行视角文件的推送,以及进行用户视角邻近视角的业务推送;Perhaps in parallel, the content server pushes the initial content to the proxy server. In particular, if the content server has the user’s perspective behavior information, it can select some perspective files for initial transmission according to the information it has; otherwise, if the content server does not With the viewing angle behavior information of the user, the content server may need to transmit a more comprehensive viewing angle file to the proxy server side. Or, when the bandwidth is relatively insufficient, the service push is postponed, that is, after receiving the request information of the user's perspective, the push of the perspective file is started, and the business push of the adjacent perspective of the user's perspective is carried out;

其中,所述配置代理服务器需要同内容服务器统一用户请求内容,在代理服务器侧的位置,代理服务器需要能够代替用户跟内容服务器请求内容,并作内容缓存;在用户真正做内容请求的时候,将内容分发用户,并进一步跟内容服务器要求用户请求或者下一步可能请求、但是尚未存储在代理服务器的内容;Wherein, the configuration of the proxy server needs to unify the content requested by the user with the content server. At the position of the proxy server, the proxy server needs to be able to replace the user to request content with the content server and cache the content; when the user actually makes a content request, the Content distribution users, and further ask the content server to request the content that the user requests or may request in the next step, but has not been stored in the proxy server;

配置的生成可以为:服务器可以告诉代理服务器,多维内容对应的维度以及各个维度内容文件位置,由代理服务器决策,多维内容各个维度内容文件在代理服务器对应的位置;The generation of configuration can be as follows: the server can tell the proxy server, the dimension corresponding to the multi-dimensional content and the location of the content file of each dimension are decided by the proxy server, and the content file of each dimension of the multi-dimensional content is in the corresponding position of the proxy server;

视角行为信息可以理解为,每一个视角获取周期,获取到的视角;比如1,视角轨迹1->3->2->…,以及视角轨迹变换的周期、时刻等。Viewpoint behavior information can be understood as each viewing angle acquisition cycle, the obtained viewing angle; for example, 1, viewing angle trajectory 1->3->2->..., and the cycle and time of viewing angle trajectory transformation.

需要说明的是,内容请求中并不一定携带视角,传统流程是在内容请求成功之后,开始请求视角;在正式的视角请求之前,基于前面所述的视角行为信息,先缓存部分内容。It should be noted that the content request does not necessarily carry the perspective. The traditional process is to start requesting the perspective after the content request is successful; before the formal perspective request, based on the above-mentioned perspective behavior information, first cache some content.

3、内容服务器面向终端设备返回代理服务器侧对应所有视角文件url’信息,以及之间的角度关系;3. The content server returns to the terminal device the url' information corresponding to all view files on the proxy server side, as well as the angle relationship between them;

4、终端设备基于收到的视角文件url’信息,选择起始url’,请求对应视角的内容文件;终端收到的是视角配置文件,比如什么样的视角对应什么样的url;基于这个信息,终端基于自己的视角,选择对应的url,进行请求4. Based on the received view file url' information, the terminal device selects the starting url' and requests the content file of the corresponding view; the terminal receives the view configuration file, such as what view corresponds to what url; based on this information , the terminal selects the corresponding url based on its own perspective, and makes a request

5、代理服务器返回终端设备所请求的视角文件url’信息;5. The proxy server returns the perspective file url' information requested by the terminal device;

6、终端设备随着用户转动头部,则根据新的角度确定新的视角文件url’信息,并发起内容请求;6. The terminal device determines the new perspective file url' information according to the new perspective as the user turns the head, and initiates a content request;

7、代理服务器根据终端设备更新的视角,返回新视角内容。7. The proxy server returns the content of the new viewing angle according to the updated viewing angle of the terminal device.

需要指出的是,在步骤4-7间,内容服务器可能收到来自代理服务器反馈的终端的视角行为信息,比如终端视角请求信息,并基于获取的信息、或者没有获取信息,持续推送代理服务器侧的视角文件,直到内容传输完整(即包含全视角文件,或者基于用户行为判断包含所有用户需要的文件,或者包含用户当前视角附近一定范围的内容文件)。It should be pointed out that, between steps 4-7, the content server may receive the viewing angle behavior information of the terminal fed back from the proxy server, such as the terminal viewing angle request information, and based on the obtained information or not obtain the information, continue to push the proxy server side View files until the content transmission is complete (that is, full view files are included, or all files needed by the user are included based on user behavior, or content files within a certain range near the user's current view angle are included).

前述流程中内容服务器和代理服务器建立相当的信任关系。内容服务器主动推送业务到代理服务器,由代理服务器支持进行内容分发的优化。该流程非常适用于内容服务商自建代理服务器,或者内容服务商和代理服务器建立稳固合同关系的场景。In the foregoing process, the content server and the proxy server establish a considerable trust relationship. The content server actively pushes services to the proxy server, and the proxy server supports optimization of content distribution. This process is very suitable for the scenario where the content service provider builds its own proxy server, or the content service provider and the proxy server establish a solid contract relationship.

备注:若对应内容文件信息已经完成存储在了代理服务器上,则图2示中的虚线交互不再需要。Note: If the corresponding content file information has been stored on the proxy server, the dotted line interaction shown in Figure 2 is no longer needed.

本实施例的另一种具体实施方式,与图2所示的方案不同之处在于,所述终端通信单元,用于获取到所述终端设备向所述内容服务器发送的内容请求;相应的,所述缓存获取单元,用于基于所述内容请求,向所述内容服务器侧请求获取缓存内容。Another specific implementation manner of this embodiment is different from the solution shown in FIG. 2 in that the terminal communication unit is configured to obtain the content request sent by the terminal device to the content server; correspondingly, The cache acquiring unit is configured to request cache content from the content server side based on the content request.

再一种处理流程,所述终端通信单元,用于与所述终端设备进行协商,得到交互信令的格式;接收到所述终端设备基于所述交互信令的格式发来的内容请求。其中,协商的过程,包括通过网络的标准化,允许用户发送网络可识别的信令,告知网络面向网络部署的代理服务器,进行对应内容请求;In another processing flow, the terminal communication unit is configured to negotiate with the terminal device to obtain an interactive signaling format; and receive a content request from the terminal device based on the interactive signaling format. Among them, the negotiation process, including the standardization of the network, allows users to send network-recognizable signaling to inform the network-oriented proxy server deployed on the network to request corresponding content;

另外,协商得到的请求内容包括:基于所述的信令格式,也就是填充对应的信息,比如内容url,通过信令封装,传递给代理服务器。In addition, the negotiated request content includes: based on the signaling format, that is, fill in corresponding information, such as content url, encapsulate it through signaling, and transmit it to the proxy server.

所述提案适用于所有涉及的角度交互或者类似角度交互的内容分发的,内容优化。The proposal is applicable to all content distribution and content optimization involving angle interaction or similar angle interaction.

所述处理单元,用于将视角、视角文件对应的链接信息进行封装得到封装信息,发送所述封装信息至所述终端设备;The processing unit is configured to encapsulate the viewing angle and the link information corresponding to the viewing angle file to obtain packaging information, and send the packaging information to the terminal device;

或者,or,

将视角、视角文件对应的链接信息进行封装得到封装信息,发送所述封装信息至所述内容服务器。Encapsulating the view and the link information corresponding to the view file to obtain encapsulation information, and sending the encapsulation information to the content server.

可见,通过采用本实施例提供的方案,就能够由代理服务器预先进行视角及其对应的视角文件的缓存,然后由代理服务器响应终端设备的视角文件请求信息为所述终端设备反馈目标视角对应的目标视角文件。如此,就能够快速响应用户业务的需求,减少终端设备获取视角文件的时延,避免用户使用终端设备的不适感。It can be seen that by adopting the solution provided in this embodiment, the proxy server can pre-cache the view angle and the corresponding view file, and then the proxy server can respond to the view file request information of the terminal device to feed back the corresponding view file for the terminal device. Target view file. In this way, it is possible to quickly respond to the user's business needs, reduce the time delay for the terminal device to obtain the view file, and avoid the user's discomfort when using the terminal device.

实施例五、Embodiment five,

本实施例提供了一种终端设备,如图7所示,包括:This embodiment provides a terminal device, as shown in FIG. 7, including:

文件请求单元71,用于向代理服务器发送视角文件请求信息;A file request unit 71, configured to send the viewing angle file request information to the proxy server;

文件获取单元72,用于接收到所述代理服务器基于所述视角文件请求信息从缓存内容中选取得到所述目标视角所对应的目标视角文件;The file obtaining unit 72 is configured to receive the target view file corresponding to the target view from the cache content selected by the proxy server based on the view file request information;

其中,所述缓存内容为所述代理服务器侧缓存的与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件。Wherein, the cache content is at least one view corresponding to the content request sent by the terminal device cached at the proxy server side, and a view file corresponding to each view.

本实施例中,所述终端设备具体可以为能够运行VR/AR的终端设备,内容服务器也为能够提供VR/AR的内容服务器。In this embodiment, the terminal device may specifically be a terminal device capable of running VR/AR, and the content server may also be a content server capable of providing VR/AR.

在终端设备的用户视角发生变化之前,代理服务器跟远端的内容服务器交互,预先缓存对应的视角文件;缓存的视角及其对应的视角文件可以是终端设备的用户在初始接入系统时所在的当前视角附近的视角及其对应的视角文件;或者,可以为代理服务器根据掌握的用户视角行为习惯预测得到的用户常用的至少一个视角及其对应的视角文件;或者,还可以为所述代理服务器在所述终端设备的用户在当前视角以外的至少一个预设视角及其对应的视角文件;Before the user's perspective of the terminal device changes, the proxy server interacts with the remote content server to pre-cache the corresponding perspective file; the cached perspective and its corresponding perspective file can be the location where the user of the terminal device initially accesses the system. The angle of view near the current angle of view and its corresponding angle of view file; or, it may be at least one angle of view commonly used by the user and its corresponding angle of view file predicted by the proxy server according to the mastered user's angle of view behavior habits; or, it may also be the proxy server At least one preset viewing angle other than the current viewing angle of the user of the terminal device and its corresponding viewing angle file;

当终端设备的用户视角发生变化时,所述终端设备向代理服务器发来新的视角文件请求信息,代理服务器基于视角文件请求信息,从预先缓存的视角对应的视角文件分发用户。When the user's perspective of the terminal device changes, the terminal device sends a new perspective file request information to the proxy server, and the proxy server distributes the perspective file corresponding to the perspective cached in advance to the user based on the perspective file request information.

具体来说,所述终端设备还包括:Specifically, the terminal equipment also includes:

内容请求单元73,用于向内容服务器发送内容请求;接收到所述内容服务器反馈的在所述代理服务器侧缓存的至少一个视角,或者,接收到所述内容服务器反馈的在所述代理服务器侧缓存的至少一个视角及其链接信息。A content request unit 73, configured to send a content request to a content server; receive at least one viewing angle cached at the proxy server side fed back by the content server, or receive the view at the proxy server side fed back by the content server Cached at least one viewpoint and its link information.

或者,or,

内容请求单元73,用于向内容服务器发送内容请求;接收到所述代理服务器反馈的其缓存的至少一个视角,或者,接收到所述内容服务器反馈的在所述代理服务器侧缓存的至少一个视角及其链接信息。A content request unit 73, configured to send a content request to a content server; receive at least one viewing angle cached by the proxy server fed back by the proxy server, or receive at least one viewing angle cached on the proxy server side fed back by the content server and its link information.

其中,所述内容请求中可以包括有至少一个维度的内容,比如,可以包括有终端设备的当前位置、当前视角等信息中的至少之一。可以理解的是,可以根据内容请求中的当前位置确定终端设备所要获取到的内容是什么,直接根据其对应的位置得知该位置处的全部视角以及每一个视角对应的视角文件。Wherein, the content request may include content with at least one dimension, for example, may include at least one of information such as a current location and a current viewing angle of the terminal device. It can be understood that the content to be obtained by the terminal device can be determined according to the current location in the content request, and all the viewing angles at the location and the viewing angle files corresponding to each viewing angle can be obtained directly according to the corresponding location.

需要说明的是,终端设备侧可以保存的内容为至少一个视角及其对应的链接信息;It should be noted that the content that can be stored on the terminal device side is at least one viewing angle and its corresponding link information;

当终端设备发起视角文件请求信息时,可以包括有一个具体的视角,也可以为根据所述视角首先确定其对应的连接信息,然后直接向代理服务器发送包含有视角(或视角文件)对应的链接信息作为所述视角文件请求信息;When a terminal device initiates a view file request message, it may include a specific view, or first determine its corresponding connection information according to the view, and then directly send a link containing the view (or view file) to the proxy server information as the view file request information;

相应的,业务服务器可以基于视角服务器中的视角,从自身缓存内容中选取得到目标视角文件;Correspondingly, the service server can select the target view file from its own cache content based on the view in the view server;

或者,所述业务服务器可以基于视角文件请求信息中的视角的链接信息,直接获取到对应的目标视角文件。Alternatively, the service server may directly acquire the corresponding target view file based on the view link information in the view file request information.

所述终端设备还包括:The terminal equipment also includes:

协商单元74,用于与所述代理服务器进行协商,得到交互信令的格式;A negotiating unit 74, configured to negotiate with the proxy server to obtain the format of the interactive signaling;

内容请求单元73,用于基于所述交互信令的格式向所述代理服务器发送内容请求;接收到所述代理服务器反馈的其缓存的至少一个视角,或者,接收到所述内容服务器反馈的在所述代理服务器侧缓存的至少一个视角及其链接信息。A content request unit 73, configured to send a content request to the proxy server based on the format of the interaction signaling; receive at least one viewing angle of its cache fed back by the proxy server, or receive the at least one viewing angle fed back by the content server The at least one view and its link information cached on the proxy server side.

其中,协商的过程,包括通过网络的标准化,允许用户发送网络可识别的信令,告知网络面向网络部署的代理服务器,进行对应内容请求;Among them, the negotiation process, including the standardization of the network, allows users to send network-recognizable signaling to inform the network-oriented proxy server deployed on the network to request corresponding content;

所述文件获取单元,还用于接收到所述代理服务器或者内容服务器发来的封装信息,所述封装信息用于表征在所述代理服务器侧以缓存的视角及其在所述代理服务器侧对应的链接信息。The file obtaining unit is further configured to receive encapsulation information sent by the proxy server or the content server, the encapsulation information is used to represent the cached perspective on the proxy server side and its corresponding link information for .

可见,通过采用本实施例提供的方案,就能够由代理服务器预先进行视角及其对应的视角文件的缓存,然后由代理服务器响应终端设备的视角文件请求信息为所述终端设备反馈目标视角对应的目标视角文件。如此,就能够快速响应用户业务的需求,减少终端设备获取视角文件的时延,避免用户使用终端设备的不适感。It can be seen that by adopting the solution provided in this embodiment, the proxy server can pre-cache the view angle and the corresponding view file, and then the proxy server can respond to the view file request information of the terminal device to feed back the corresponding view file for the terminal device. Target view file. In this way, it is possible to quickly respond to the user's business needs, reduce the time delay for the terminal device to obtain the view file, and avoid the user's discomfort when using the terminal device.

实施例六、Embodiment six,

本发明实施例提供了一种内容服务器,如图8所示包括:An embodiment of the present invention provides a content server, as shown in Figure 8, including:

缓存发送单元81,用于基于终端设备发出的内容请求,向终端设备的代理服务器发送缓存内容;其中,所述缓存内容为与所述终端设备发出的内容请求对应的至少一个视角,以及每一个视角所对应的视角文件。The cache sending unit 81 is configured to send the cache content to the proxy server of the terminal device based on the content request sent by the terminal device; wherein, the cache content is at least one view corresponding to the content request sent by the terminal device, and each The view file corresponding to the view.

本实施例中,所述终端设备具体可以为能够运行VR/AR的终端设备,内容服务器也为能够提供VR/AR的内容服务器。In this embodiment, the terminal device may specifically be a terminal device capable of running VR/AR, and the content server may also be a content server capable of providing VR/AR.

在终端设备的用户视角发生变化之前,代理服务器跟远端的内容服务器交互,预先缓存对应的视角文件;缓存的视角及其对应的视角文件可以是终端设备的用户在初始接入系统时所在的当前视角附近的视角及其对应的视角文件;或者,可以为代理服务器根据掌握的用户视角行为习惯预测得到的用户常用的至少一个视角及其对应的视角文件;或者,还可以为所述代理服务器在所述终端设备的用户在当前视角以外的至少一个预设视角及其对应的视角文件;Before the user's perspective of the terminal device changes, the proxy server interacts with the remote content server to pre-cache the corresponding perspective file; the cached perspective and its corresponding perspective file can be the location where the user of the terminal device initially accesses the system. The angle of view near the current angle of view and its corresponding angle of view file; or, it may be at least one angle of view commonly used by the user and its corresponding angle of view file predicted by the proxy server according to the mastered user's angle of view behavior habits; or, it may also be the proxy server At least one preset viewing angle other than the current viewing angle of the user of the terminal device and its corresponding viewing angle file;

当终端设备的用户视角发生变化时,所述终端设备向代理服务器发来新的视角文件请求信息,代理服务器基于视角文件请求信息,从预先缓存的视角对应的视角文件分发用户。When the user's perspective of the terminal device changes, the terminal device sends a new perspective file request information to the proxy server, and the proxy server distributes the perspective file corresponding to the perspective cached in advance to the user based on the perspective file request information.

具体来说,所缓存发送单元,用于向所述内容服务器侧,发出与的内容请求对应的全部视角、以及每一个视角对应的视角文件;Specifically, the buffered sending unit is configured to send to the content server side all views corresponding to the content request and a view file corresponding to each view;

或者,or,

向所述内容服务器侧,发出与所述终端设备的常用视角及其对应的视角文件;sending the commonly used viewing angles of the terminal device and corresponding viewing angle files to the content server side;

或者,or,

向所述内容服务器侧,发出与终端设备当前视角对应的视角文件,并获取到所述当前视角的至少一个相关视角及其对应的视角文件;其中,所述相关视角表征与所述当前视角之间的角度差值小于预设门限值的视角。To the content server side, send a viewing angle file corresponding to the current viewing angle of the terminal device, and obtain at least one related viewing angle of the current viewing angle and its corresponding viewing angle file; The angle difference between them is smaller than the preset threshold value.

所述预设门限值可以根据实际情况进行设置,比如可以为左右30度之内,或者还可以包含上下30度之内。The preset threshold value can be set according to the actual situation, for example, it can be within 30 degrees left and right, or it can also be included within 30 degrees up and down.

需要说明的是,终端设备侧可以保存的内容为至少一个视角及其对应的链接信息;It should be noted that the content that can be stored on the terminal device side is at least one viewing angle and its corresponding link information;

当终端设备发起视角文件请求信息时,可以包括有一个具体的视角,也可以为根据所述视角首先确定其对应的连接信息,然后直接向代理服务器发送包含有视角(或视角文件)对应的链接信息作为所述视角文件请求信息;When a terminal device initiates a view file request message, it may include a specific view, or first determine its corresponding connection information according to the view, and then directly send a link containing the view (or view file) to the proxy server information as the view file request information;

相应的,业务服务器可以基于视角服务器中的视角,从自身缓存内容中选取得到目标视角文件;Correspondingly, the service server can select the target view file from its own cache content based on the view in the view server;

或者,所述业务服务器可以基于视角文件请求信息中的视角的链接信息,直接获取到对应的目标视角文件。Alternatively, the service server may directly acquire the corresponding target view file based on the view link information in the view file request information.

所述内容服务器还包括:The content server also includes:

缓存更新单元82,用于向所述代理服务器发送新的至少一个视角以及每一个新的视角所对应的视角文件,其中,所述新的至少一个视角及其对应的视角文件用于更新所述代理服务器的缓存内容。A cache update unit 82, configured to send at least one new view and a view file corresponding to each new view to the proxy server, wherein the at least one new view and its corresponding view file are used to update the The content of the proxy server's cache.

也就是说,所述代理服务器还可以根据用户视角、或者基于缺失的视角文件,持续跟所述内容服务器进行交互以获取更新的缓存内容。That is to say, the proxy server may continue to interact with the content server to obtain updated cached content according to the user's perspective or based on a missing perspective file.

所述内容服务器还包括:The content server also includes:

通信单元83,用于接收到所述终端设备、或者、接收到所述代理服务器发来的内容请求。The communication unit 83 is configured to receive the terminal device, or receive the content request sent by the proxy server.

所述通信单元83,用于接收到所述代理服务器发来的将视角、视角文件对应的链接信息进行封装得到封装信息;The communication unit 83 is configured to receive the encapsulation information sent by the proxy server by encapsulating the view angle and the link information corresponding to the view file;

通信单元83,用于发送所述封装信息至所述终端设备。A communication unit 83, configured to send the encapsulation information to the terminal device.

可见,通过采用本实施例提供的方案,就能够由代理服务器预先进行视角及其对应的视角文件的缓存,然后由代理服务器响应终端设备的视角文件请求信息为所述终端设备反馈目标视角对应的目标视角文件。如此,就能够快速响应用户业务的需求,减少终端设备获取视角文件的时延,避免用户使用终端设备的不适感。It can be seen that by adopting the solution provided in this embodiment, the proxy server can pre-cache the view angle and the corresponding view file, and then the proxy server can respond to the view file request information of the terminal device to feed back the corresponding view file of the target view to the terminal device. Target view file. In this way, it is possible to quickly respond to the user's business needs, reduce the time delay for the terminal device to obtain the view file, and avoid the user's discomfort when using the terminal device.

需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the above embodiments of the present invention are for description only, and do not represent the advantages and disadvantages of the embodiments.

通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,装置,空调器,或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to enable a terminal device (which may be a mobile phone, a computer, a device, an air conditioner, or a network device, etc.) to execute the methods described in various embodiments of the present invention.

以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (36)

1. An information transmission method applied to a proxy server is characterized by comprising the following steps:
acquiring at least one visual angle corresponding to a content request sent by terminal equipment and a visual angle file corresponding to the visual angle from a content server side of the terminal equipment, and adding the at least one visual angle and the visual angle file corresponding to the at least one visual angle to cache content;
receiving visual angle file request information sent by the terminal equipment;
and selecting a target view file corresponding to a target view from the cache contents based on the view file request information, and sending the target view file to the terminal equipment.
2. The method according to claim 1, wherein the obtaining of the cache content from the content server side of the terminal device comprises:
acquiring all views corresponding to content requests sent by the terminal equipment and view files corresponding to all views from a content server side of the terminal equipment;
or,
acquiring a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle from a content server side of the terminal equipment;
or,
acquiring a view file corresponding to a current view of the terminal equipment from a content server side of the terminal equipment, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
3. The method according to claim 1, wherein when the target view file corresponding to the target view is selected from the cache contents based on the target view in the view file request information and sent to the terminal device, the method further comprises:
if the proxy server does not store all views corresponding to the content request sent by the terminal equipment and files corresponding to the views, acquiring at least one new view and a view file corresponding to each new view from the content server; updating cache content based on the new at least one view and a view file corresponding to the new at least one view;
or,
if the proxy server does not store all view files corresponding to the view file request information sent by the terminal equipment, acquiring at least one new view file from the content server; updating the cached content based on the new at least one view file.
4. The method according to claim 3, wherein if the proxy server does not store all views and files corresponding to the views corresponding to the content request sent by the terminal device, acquiring a new at least one view and a view file corresponding to each new view from the content server includes:
predicting at least one view angle required to be acquired by the terminal equipment based on the view angle corresponding to the received view angle file request information to obtain at least one predicted view angle;
judging whether the at least one predicted view and a view file corresponding to the predicted view are stored in the existing cache content;
and if not, acquiring at least one new visual angle and a visual angle file corresponding to each new visual angle from the content server side based on the at least one predicted visual angle.
5. The method according to any one of claims 1-4, further comprising:
determining views contained in the cache content acquired from the content server and the number of view files corresponding to the views based on at least the attribute information of the terminal device;
wherein, the attribute information comprises at least one of the following information:
a view refresh rate in the terminal device;
an available transmission bandwidth of the terminal device;
a maximum transmission bandwidth of the terminal device.
6. The method according to claim 1, wherein before the obtaining of the cached content from the content server side of the terminal device, the method further comprises:
acquiring a content request sent to the content server by the terminal equipment;
and requesting to acquire cache content from the content server side based on the content request.
7. The method according to claim 1, wherein before the obtaining of the cached content from the content server side of the terminal device, the method further comprises:
negotiating with the terminal equipment to obtain a format of an interactive signaling;
receiving a content request sent by the terminal equipment based on the format of the interactive signaling;
and requesting to acquire cache content from the content server side based on the content request.
8. The method of claim 1, further comprising:
packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the terminal equipment;
or,
and packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the content server.
9. An information transmission method is applied to terminal equipment, and is characterized in that the method comprises the following steps:
sending view file request information to a proxy server;
selecting a target view file corresponding to the target view from the cache contents based on the view file request information received by the proxy server;
the cached content is at least one view angle cached by the proxy server side and corresponding to the content request sent by the terminal equipment, and a view angle file corresponding to each view angle.
10. The method of claim 9, wherein before sending the view file request information to the proxy server, the method further comprises:
sending a content request to a content server;
and receiving at least one view cached at the proxy server side fed back by the content server, or receiving at least one view cached at the proxy server side and link information thereof fed back by the content server.
11. The method of claim 9, wherein before sending the view file request information to the proxy server, the method further comprises:
sending a content request to a content server;
and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
12. The method of claim 9, wherein before sending the view file request information to the proxy server, the method further comprises:
negotiating with the proxy server to obtain the format of the interactive signaling;
sending a content request to the proxy server based on the format of the interactive signaling;
and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
13. The method of claim 9, further comprising:
and receiving packaging information sent by the proxy server or the content server, wherein the packaging information is used for representing the view angle cached at the proxy server side and the link information corresponding to the proxy server side.
14. An information transmission method applied to a content server, the method comprising:
based on a content request sent by a terminal device, at least one view corresponding to the content request sent by the terminal device and a view file corresponding to the view are sent to a proxy server of the terminal device.
15. The method of claim 14, wherein sending the cached content to a proxy server of the terminal device comprises:
sending all the visual angles corresponding to the content request and a visual angle file corresponding to each visual angle to the content server side;
or,
sending a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle to the content server side;
or,
sending a view file corresponding to the current view of the terminal equipment to the content server side, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
16. The method of claim 14, further comprising:
and sending a new at least one visual angle and a visual angle file corresponding to each new visual angle to the proxy server, wherein the new at least one visual angle and the visual angle file corresponding to the new visual angle are used for updating the cache content of the proxy server.
17. The method according to claim 14, wherein the content request based on the terminal device further comprises:
and receiving the terminal equipment or receiving a content request sent by the proxy server.
18. The method of claim 14, further comprising:
and receiving link information which is sent by the proxy server and corresponds to the view angle and the view angle file, packaging the link information to obtain packaging information, and sending the packaging information to the terminal equipment.
19. A proxy server, comprising:
the system comprises a cache acquisition unit, a cache processing unit and a cache processing unit, wherein the cache acquisition unit is used for acquiring at least one visual angle corresponding to a content request sent by terminal equipment and a visual angle file corresponding to the visual angle from a content server side of the terminal equipment and adding the at least one visual angle and the visual angle file corresponding to the visual angle to cache content;
the terminal communication unit is used for receiving the view file request information sent by the terminal equipment; and selecting a target view file corresponding to a target view from the cache contents based on the view file request information, and sending the target view file to the terminal equipment.
20. The proxy server according to claim 19, wherein the cache obtaining unit is configured to obtain, from a content server side of the terminal device, all views corresponding to content requests sent by the terminal device and view files corresponding to each view;
or,
the cache obtaining unit is used for obtaining a common view angle of the terminal equipment and a view angle file corresponding to the common view angle from a content server side of the terminal equipment;
or,
the cache obtaining unit is configured to obtain, from a content server side of the terminal device, a view file corresponding to a current view of the terminal device, and obtain at least one relevant view of the current view and a view file corresponding to the relevant view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
21. The proxy server according to claim 19, wherein the cache obtaining unit is configured to obtain, from the content server, at least one new view and a view file corresponding to each new view if the proxy server does not store all views and files corresponding to all views corresponding to content requests sent by the terminal device; updating cache content based on the new at least one view and a view file corresponding to the new at least one view;
or,
the cache obtaining unit is configured to obtain at least one new view file from the content server if the proxy server does not store all view files corresponding to the view file request information sent by the terminal device; updating the cached content based on the new at least one view file.
22. The proxy server according to claim 21, wherein the cache obtaining unit is configured to predict, based on a view corresponding to the received view file request information, at least one view that needs to be obtained by the terminal device, so as to obtain at least one predicted view;
judging whether the at least one predicted view and a view file corresponding to the predicted view are stored in the existing cache content;
and if not, acquiring at least one new visual angle and a visual angle file corresponding to each new visual angle from the content server side based on the at least one predicted visual angle.
23. A proxy server as claimed in any one of claims 19 to 22, further comprising:
the processing unit is used for determining the number of the view angles and the view angle files corresponding to the view angles, which are contained in the cache content acquired from the content server, at least based on the attribute information of the terminal equipment;
wherein, the attribute information comprises at least one of the following information:
a view refresh rate in the terminal device;
an available transmission bandwidth of the terminal device;
a maximum transmission bandwidth of the terminal device.
24. The proxy server according to claim 19, wherein the terminal communication unit is configured to obtain a content request sent by the terminal device to the content server;
correspondingly, the cache obtaining unit is configured to request the content server side to obtain cache content based on the content request.
25. The proxy server according to claim 19, wherein the terminal communication unit is configured to negotiate with the terminal device to obtain a format of the interactive signaling; and receiving a content request sent by the terminal equipment based on the format of the interactive signaling.
26. The proxy server of claim 19, further comprising:
the processing unit is used for packaging the view angle and the link information corresponding to the view angle file to obtain packaging information and sending the packaging information to the terminal equipment;
or,
and packaging the view angle and the link information corresponding to the view angle file to obtain packaging information, and sending the packaging information to the content server.
27. A terminal device, comprising:
the file request unit is used for sending the view file request information to the proxy server;
the file acquisition unit is used for receiving the target view file corresponding to the target view selected from the cache contents by the proxy server based on the view file request information;
the cached content is at least one view angle cached by the proxy server side and corresponding to the content request sent by the terminal equipment, and a view angle file corresponding to each view angle.
28. The terminal device of claim 27, wherein the terminal device further comprises:
a content request unit for transmitting a content request to a content server; and receiving at least one view cached at the proxy server side fed back by the content server, or receiving at least one view cached at the proxy server side and link information thereof fed back by the content server.
29. The terminal device of claim 27, wherein the terminal device further comprises:
a content request unit for transmitting a content request to a content server; and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
30. The terminal device of claim 27, wherein the terminal device further comprises:
a negotiation unit, configured to negotiate with the proxy server to obtain a format of an interactive signaling;
a content request unit, configured to send a content request to the proxy server based on the format of the interactive signaling; and receiving at least one cached view fed back by the proxy server, or receiving at least one cached view and link information thereof at the proxy server side fed back by the content server.
31. The terminal device according to claim 27, wherein the file obtaining unit is configured to receive package information sent by the proxy server or a content server, where the package information is used to characterize a view cached at the proxy server and link information corresponding to the view at the proxy server.
32. A content server, comprising:
the cache sending unit is used for sending at least one view angle corresponding to the content request sent by the terminal equipment and a view angle file corresponding to each view angle to a proxy server of the terminal equipment based on the content request sent by the terminal equipment.
33. The content server according to claim 32, wherein the cache sending unit is configured to send, to the content server side, all views corresponding to the content request and view files corresponding to each view;
or,
sending a common visual angle of the terminal equipment and a visual angle file corresponding to the common visual angle to the content server side;
or,
sending a view file corresponding to the current view of the terminal equipment to the content server side, and acquiring at least one related view of the current view and a view file corresponding to the view; and the angle difference value between the related visual angle representation and the current visual angle is smaller than a preset threshold value.
34. The content server according to claim 32, wherein the content server further comprises:
and the cache updating unit is used for sending a new at least one view and a view file corresponding to each new view to the proxy server, wherein the new at least one view and the view file corresponding to the new view are used for updating the cache content of the proxy server.
35. The content server according to claim 32, wherein the content server further comprises:
and the communication unit is used for receiving the terminal equipment or receiving the content request sent by the proxy server.
36. The content server according to claim 32, wherein the content server further comprises:
the communication unit is used for receiving the link information which is sent by the proxy server and corresponds to the view angle and the view angle file, and packaging the link information to obtain packaging information; and the terminal equipment is used for sending the packaging information to the terminal equipment.
CN201710108777.3A 2017-02-27 2017-02-27 Information transmission method, proxy server, terminal device and content server Active CN108513096B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710108777.3A CN108513096B (en) 2017-02-27 2017-02-27 Information transmission method, proxy server, terminal device and content server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710108777.3A CN108513096B (en) 2017-02-27 2017-02-27 Information transmission method, proxy server, terminal device and content server

Publications (2)

Publication Number Publication Date
CN108513096A true CN108513096A (en) 2018-09-07
CN108513096B CN108513096B (en) 2021-09-14

Family

ID=63373919

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710108777.3A Active CN108513096B (en) 2017-02-27 2017-02-27 Information transmission method, proxy server, terminal device and content server

Country Status (1)

Country Link
CN (1) CN108513096B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101300840A (en) * 2005-11-04 2008-11-05 微软公司 Multi-view video delivery
CN101998116A (en) * 2009-08-31 2011-03-30 中国移动通信集团公司 Method, system and equipment for realizing multi-view video service
CN102056015A (en) * 2009-11-04 2011-05-11 沈阳隆惠科技有限公司 Streaming media application method in panoramic virtual reality roaming
US20150113581A1 (en) * 2011-01-10 2015-04-23 Dropbox, Inc. System and method for sharing virtual and augmented reality scenes between users and viewers
CN104602129A (en) * 2015-01-27 2015-05-06 三星电子(中国)研发中心 Playing method and system of interactive multi-view video
CN105913478A (en) * 2015-12-28 2016-08-31 乐视致新电子科技(天津)有限公司 360-degree panorama display method and display module, and mobile terminal
CN105933343A (en) * 2016-06-29 2016-09-07 深圳市优象计算技术有限公司 Stream cache mechanism used for network play of 720-degree panoramic video
CN106454401A (en) * 2016-10-26 2017-02-22 乐视网信息技术(北京)股份有限公司 Method and device for playing video

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101300840A (en) * 2005-11-04 2008-11-05 微软公司 Multi-view video delivery
CN101998116A (en) * 2009-08-31 2011-03-30 中国移动通信集团公司 Method, system and equipment for realizing multi-view video service
CN102056015A (en) * 2009-11-04 2011-05-11 沈阳隆惠科技有限公司 Streaming media application method in panoramic virtual reality roaming
US20150113581A1 (en) * 2011-01-10 2015-04-23 Dropbox, Inc. System and method for sharing virtual and augmented reality scenes between users and viewers
CN104602129A (en) * 2015-01-27 2015-05-06 三星电子(中国)研发中心 Playing method and system of interactive multi-view video
CN105913478A (en) * 2015-12-28 2016-08-31 乐视致新电子科技(天津)有限公司 360-degree panorama display method and display module, and mobile terminal
CN105933343A (en) * 2016-06-29 2016-09-07 深圳市优象计算技术有限公司 Stream cache mechanism used for network play of 720-degree panoramic video
CN106454401A (en) * 2016-10-26 2017-02-22 乐视网信息技术(北京)股份有限公司 Method and device for playing video

Also Published As

Publication number Publication date
CN108513096B (en) 2021-09-14

Similar Documents

Publication Publication Date Title
US10757067B2 (en) Just in time transcoding and packaging in IPV6 networks
US10616301B2 (en) Request-based encoding for streaming content portions
CN101626385B (en) media service method and system
AU2021200397B2 (en) Resource segmentation to improve delivery performance
US9401885B2 (en) Data push service method and system using data pull model
JP2014523667A (en) Location and extraction of segmented content
KR20090054897A (en) Method and apparatus for searching IP service provider and ISP service using SPI protocol
CN101409706A (en) Method, system and relevant equipment for distributing data of edge network
US20110082943A1 (en) P2p network system and data transmitting and receiving method thereof
US20110276630A1 (en) Content delivery over a peer-to-peer network
US10931763B2 (en) Systems and methods for opaque object delivery in a communication network
CN115314730B (en) Video streaming transmission method and device applied to Virtual Reality (VR) scene
CN104618738A (en) Method and device for playing programs of intelligent TV
CN110266987B (en) Passive video recording method and computer readable storage medium
CN108513096B (en) Information transmission method, proxy server, terminal device and content server
Mekuria et al. Multi-protocol video delivery with late trans-muxing
WO2014177058A1 (en) Transmission method and device for file data
CN108989426A (en) Drawing stream method, system and client and storage medium based on HLS protocol
JP2005275690A (en) Authentication substituting method, distribution management device, and program for authentication substitution method
KR20160147861A (en) Information object acquisition method, server and user equipment
US20050177874A1 (en) Access information generating device, access information generating method and receiver device
WO2023071468A1 (en) Live broadcasting method, content distribution service device, and storage medium
WO2017071524A1 (en) Multimedia resource publishing method and apparatus
JP6121964B2 (en) Access restriction method, distribution system, and reverse proxy server
KR20150050669A (en) Apparatus and Method for Multi-source downloading

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant